00000001:02000400:0.0F:1789264019.454422:0:3300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789264031.050258:0:3499:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1789264032.160431:0:3562:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1171 MB/s 00000001:01000000:3.0F:1789264032.410390:0:3562:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1271 MB/s 00000001:01000000:2.0F:1789264032.659846:0:3562:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8939 MB/s 00000020:02000000:3.0:1789264033.017206:0:3591:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_104_g543d5f9 00000400:02000000:2.0:1789264033.484203:0:3606:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.144@tcp [8/256/0/180] 00008000:02000000:0.0:1789264036.220175:0:3755:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789264071.957060:0:5718:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789264079.440732:0:6467:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789264079.440739:0:6467:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789264079.440740:0:6467:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789264079.440930:0:6467:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000fc976304 00000080:02000400:0.0:1789264079.440939:0:6467:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789264079.447820:0:6467:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789264079.447831:0:6467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789264079.448267:0:6467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000003021faf6) 00000020:00000080:3.0:1789264079.448295:0:6467:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789264079.483831:0:6467:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789264079.483908:0:6467:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1789264079.506827:0:6467:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789264079.506972:0:6467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789264079.506978:0:6467:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789264079.506989:0:6467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed66c9 00000020:01000004:2.0:1789264079.506995:0:6467:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789264079.506999:0:6467:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789264079.507003:0:6467:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fc976304 from MGS 00000020:01000004:2.0:1789264079.507007:0:6467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789264079.507025:0:6467:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a98fbde6) 00000020:00000080:2.0:1789264079.507037:0:6467:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789264079.507143:0:6467:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fc976304 from MGS, refs=2 00080000:01000000:2.0:1789264079.507148:0:6467:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789264079.507152:0:6467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed66d7 00000100:00100000:2.0:1789264079.507250:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789264079.507403:0:6467:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789264079.507409:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789264079.509104:0:6467:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789264079.509117:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789264079.511706:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789264079.512023:0:6467:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789264079.512030:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789264079.513454:0:6467:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789264079.513465:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789264079.513902:0:6467:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789264079.513909:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789264079.514446:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264079.514449:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264079.514450:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264079.515137:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264079.515140:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264079.515142:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264079.516479:0:6467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789264079.518155:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789264079.765918:0:6467:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 5675 MB/s 00000001:01000000:2.0:1789264080.015878:0:6467:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7327 MB/s 00000001:01000000:2.0:1789264080.266253:0:6467:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1303 MB/s 00000001:01000000:2.0:1789264080.516241:0:6467:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1583 MB/s 00080000:10000000:2.0:1789264080.521192:0:6467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1789264080.522633:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789264080.527674:0:6467:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789264080.528521:0:6481:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789264080.528549:0:6467:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789264080.528576:0:6467:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789264080.528703:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789264080.528726:0:6467:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789264080.529147:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789264080.529349:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789264080.529357:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789264080.530254:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789264080.530262:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789264080.530996:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789264080.531002:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789264080.531732:0:6467:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789264080.531767:0:6467:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.144@tcp' 00000020:01000004:3.0:1789264080.531769:0:6467:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789264080.531818:0:6467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.144@tcp (typ=mgc) 00000020:00000080:3.0:1789264080.531829:0:6467:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.144@tcp (0000000028f6bbc6) 00000020:00000080:3.0:1789264080.531845:0:6467:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789264080.531939:0:6467:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000052841829@MGC192.168.203.144@tcp: add connection 192.168.203.144@tcp at head 00010000:00010000:3.0:1789264080.532116:0:6467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.144@tcp-0 is initialized 00000040:01000000:3.0:1789264080.532123:0:6467:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789264080.533131:0:6487:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789264080.533162:0:6467:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.144@tcp (uuid 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a) 00000020:00000080:3.0:1789264080.533176:0:6467:0:(genops.c:1385:class_connect()) connect: client 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a, cookie 0xecaf9f2f14ed66e5 00000100:00080000:3.0:1789264080.533186:0:6467:0:(import.c:510:import_select_connection()) MGC192.168.203.144@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789264080.533191:0:6467:0:(import.c:624:import_select_connection()) MGC192.168.203.144@tcp: import 0000000052841829 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1789264080.533231:0:6467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001c60099b x1876179322667136/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789264080.533262:0:6467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a->MGS 00000020:01000004:3.0:1789264080.533277:0:6467:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789264080.533281:0:6467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789264080.533290:0:6467:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000039787f02) 00000020:00000080:3.0:1789264080.533300:0:6467:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:0.0:1789264080.534626:0:6486:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1789264080.534633:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c60099b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3621:1876179322667136:0@lo:250: 00000100:00100000:2.0:1789264080.534699:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264080.534945:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322667136 00000100:00100000:2.0:1789264080.534953:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322667136 00000100:00100000:2.0:1789264080.534981:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789264080.534988:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e170001 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3621:x1876179322667136:12345-0@lo:250: 00010000:00080000:2.0:1789264080.535014:0:6482:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:2.0:1789264080.535041:0:6482:0:(genops.c:1385:class_connect()) connect: client 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a, cookie 0xecaf9f2f14ed66f3 00000100:00080000:2.0:1789264080.535190:0:6482:0:(import.c:65:import_set_state_nolock()) 0000000044747478 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789264080.535245:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e170001 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:3621:x1876179322667136:12345-0@lo:250: Request processed in 256us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264080.535253:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789264080.535301:0:3621:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.144@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789264080.535309:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.144@tcp: connect to target with instance 0 00000100:00080000:2.0:1789264080.535316:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.144@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789264080.535320:0:3621:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789264080.535322:0:3621:0:(import.c:65:import_set_state_nolock()) 0000000052841829 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789264080.535325:0:3621:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789264080.535331:0:3621:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789264080.535335:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c60099b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3621:1876179322667136:0@lo:250: 00000100:00100000:3.0:1789264080.542495:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789264080.542683:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789264080.542688:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789264080.543947:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789264080.543956:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789264080.545004:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789264080.545012:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789264080.545681:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789264080.546029:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789264080.546034:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789264080.546462:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789264080.546469:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789264080.570403:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789264080.570563:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789264080.570568:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789264080.571435:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789264080.571441:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789264080.572054:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789264080.572183:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789264080.572188:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789264080.572541:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789264080.572547:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789264080.573213:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789264080.573343:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789264080.573348:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789264080.573832:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789264080.573838:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789264080.574307:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789264080.574436:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789264080.574441:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789264080.574954:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789264080.574961:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789264080.587731:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789264080.588117:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789264080.588123:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789264080.589207:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789264080.589217:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789264080.589912:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789264080.589920:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789264080.590726:0:6467:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789264080.590877:0:6467:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789264080.590883:0:6467:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789264080.590979:0:6467:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789264080.591009:0:6467:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.144@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789264080.591013:0:6467:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789264080.591014:0:6467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789264080.591016:0:6467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264080.591016:0:6467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789264080.591017:0:6467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264080.591019:0:6467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264080.591020:0:6467:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789264080.591022:0:6467:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789264080.591023:0:6467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789264080.591028:0:6467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789264080.591029:0:6467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264080.591030:0:6467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789264080.591033:0:6467:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789264080.591035:0:6467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789264080.591036:0:6467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789264080.591036:0:6467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264080.591037:0:6467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789264080.591038:0:6467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264080.591039:0:6467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264080.591039:0:6467:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789264080.591040:0:6467:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789264080.591041:0:6467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789264080.591042:0:6467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789264080.591042:0:6467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264080.591043:0:6467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789264080.591075:0:6467:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789264080.591096:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fcb4b628 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322667264:0@lo:253: 00000100:00100000:0.0:1789264080.591172:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264080.591266:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 000000007345a09b going to sleep for 11 seconds 00000100:00100000:2.0:1789264080.591362:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322667264 00000100:00100000:2.0:1789264080.591368:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322667264 00000100:00100000:2.0:1789264080.591451:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789264080.591459:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000210f567c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:6467:x1876179322667264:12345-0@lo:253: 20000000:01000000:2.0:1789264080.591512:0:6485:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789264080.591515:0:6485:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789264080.592163:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789264080.592253:0:6485:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789264080.592569:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789264080.593591:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789264080.593779:0:6485:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789264080.593783:0:6485:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789264080.593789:0:6485:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789264080.593791:0:6485:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789264080.593806:0:6485:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789264080.593935:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789264080.594143:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789264080.594156:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789264080.594184:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789264080.594202:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789264080.594216:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789264080.594276:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789264080.594285:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789264080.594298:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789264080.594313:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789264080.594326:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789264080.594331:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789264080.594341:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789264080.594358:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789264080.594386:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789264080.594392:0:6485:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789264080.594398:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789264080.594512:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789264080.594522:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789264080.594537:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789264080.594553:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789264080.594567:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789264080.594575:0:6485:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789264080.594599:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789264080.594606:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789264080.594617:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789264080.594632:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789264080.594646:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789264080.594655:0:6485:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789264080.594679:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789264080.594687:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789264080.594700:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789264080.594715:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789264080.594786:0:6485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789264080.594811:0:6485:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789264080.594818:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789264080.595694:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789264080.596000:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789264080.596029:0:6485:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.144@tcp for mdt 20000000:01000000:2.0:1789264080.596032:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:2.0:1789264080.596050:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789264080.596059:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789264080.596073:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789264080.596081:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:2.0:1789264080.596095:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789264080.596102:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789264080.596114:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789264080.596133:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789264080.596174:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789264080.596177:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789264080.596180:0:6485:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789264080.596221:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789264080.596224:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789264080.597376:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1789264080.597635:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789264080.597661:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1789264080.597678:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1789264080.597689:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789264080.597692:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789264080.598663:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789264080.599239:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789264080.599264:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789264080.599279:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1789264080.599290:0:6485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789264080.599292:0:6485:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1789264080.599298:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789264080.599299:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789264080.599304:0:6485:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789264080.599309:0:6485:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789264080.599673:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1789264080.599856:0:6485:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789264080.607211:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1789264080.607249:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1789264080.607264:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1789264080.607287:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789264080.607307:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002438a479/0xecaf9f2f14ed66fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.607323:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002438a479/0xecaf9f2f14ed66fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.607334:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002438a479/0xecaf9f2f14ed66fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.607340:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002438a479/0xecaf9f2f14ed66fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.607346:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002438a479/0xecaf9f2f14ed66fa lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.607351:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002438a479/0xecaf9f2f14ed66fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.607374:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002438a479 already unused, calling callback (00000000fe6a1ae7) 00010000:00010000:0.0:1789264080.607378:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002438a479/0xecaf9f2f14ed66fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.607385:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002438a479/0xecaf9f2f14ed66fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.607397:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002438a479/0xecaf9f2f14ed66fa lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.607404:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002438a479/0xecaf9f2f14ed66fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.607410:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002438a479/0xecaf9f2f14ed66fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789264080.607429:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789264080.620592:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000210f567c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:6467:x1876179322667264:12345-0@lo:253: Request processed in 29126us (29413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264080.620612:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789264080.620630:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fcb4b628 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322667264:0@lo:253: 10000000:01000000:3.0:1789264080.620648:0:6467:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789264080.620655:0:6467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789264080.620657:0:6467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789264080.620659:0:6467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789264080.620660:0:6467:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789264080.620661:0:6467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789264080.620663:0:6467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789264080.620664:0:6467:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789264080.620665:0:6467:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789264080.620667:0:6467:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789264080.620668:0:6467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789264080.620669:0:6467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789264080.620689:0:6467:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fc976304 from lustre-MDT0000 10000000:01000000:3.0:1789264080.620728:0:6467:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789264080.620731:0:6467:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789264080.620735:0:6467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c3aaa494d28 10000000:01000000:3.0:1789264080.620771:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789264080.620781:0:6467:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c3aaa494d28 from 1 10000000:01000000:3.0:1789264080.620784:0:6467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789264080.620815:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.620838:0:6467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.620845:0:6467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264080.620859:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322667392:0@lo:101: 00000100:00100000:3.0:1789264080.620886:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264080.620926:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cebb56b going to sleep for 11 seconds 00000100:00100000:2.0:1789264080.621244:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322667392 00000100:00100000:2.0:1789264080.621252:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322667392 00000100:00100000:2.0:1789264080.621368:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789264080.621377:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c06e203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:6467:x1876179322667392:12345-0@lo:101: 00010000:00010000:2.0:1789264080.621396:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264080.621411:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000640af581/0xecaf9f2f14ed6708 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6701 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.621435:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000640af581/0xecaf9f2f14ed6708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6701 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.621445:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000640af581/0xecaf9f2f14ed6708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6701 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.621461:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000640af581, rc 0) 00000100:00100000:2.0:1789264080.621512:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c06e203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+6:6467:x1876179322667392:12345-0@lo:101: Request processed in 136us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264080.621519:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789264080.621545:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322667392:0@lo:101: 00010000:00010000:3.0:1789264080.621570:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6708 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.621579:0:6467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6708 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264080.621658:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322667520:0@lo:501: 00000100:00100000:3.0:1789264080.621686:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264080.623588:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322667520 00000100:00100000:0.0:1789264080.623600:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322667520 00000100:00100000:3.0:1789264080.623636:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cebb56b going to sleep for 11 seconds 00000100:00100000:0.0:1789264080.623677:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789264080.623684:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb8afec3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+6:6467:x1876179322667520:12345-0@lo:501: 00000100:00100000:0.0:1789264080.623800:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb8afec3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+6:6467:x1876179322667520:12345-0@lo:501: Request processed in 115us (2112us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789264080.623807:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789264080.623818:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322667520:0@lo:501: 10000000:01000000:3.0:1789264080.623857:0:6467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789264080.623878:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6708 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.623887:0:6467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6708 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264080.623909:0:6467:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c3a89eb9800 10000000:01000000:3.0:1789264080.623914:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789264080.623919:0:6467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c3a89eb9800 10000000:01000000:3.0:1789264080.623921:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789264080.623925:0:6467:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c3a89eb9800 from 1 10000000:01000000:3.0:1789264080.623927:0:6467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789264080.623954:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 000000006a3a7d9b/0xecaf9f2f14ed670f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.623961:0:6467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 000000006a3a7d9b/0xecaf9f2f14ed670f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.623969:0:6467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 000000006a3a7d9b/0xecaf9f2f14ed670f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264080.623986:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322667648:0@lo:101: 00000100:00100000:3.0:1789264080.624017:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264080.624044:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cebb56b going to sleep for 11 seconds 00000100:00100000:2.0:1789264080.624128:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322667648 00000100:00100000:2.0:1789264080.624134:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322667648 00000100:00100000:2.0:1789264080.624171:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789264080.624177:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007835a534 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+6:6467:x1876179322667648:12345-0@lo:101: 00010000:00010000:2.0:1789264080.624185:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264080.624196:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000051c18d9f/0xecaf9f2f14ed6716 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed670f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.624216:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051c18d9f/0xecaf9f2f14ed6716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed670f expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.624226:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000051c18d9f/0xecaf9f2f14ed6716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed670f expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.624235:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000051c18d9f, rc 0) 00000100:00100000:2.0:1789264080.624278:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007835a534 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+7:6467:x1876179322667648:12345-0@lo:101: Request processed in 101us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264080.624285:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789264080.624297:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322667648:0@lo:101: 00010000:00010000:3.0:1789264080.624313:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 000000006a3a7d9b/0xecaf9f2f14ed670f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.624322:0:6467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 000000006a3a7d9b/0xecaf9f2f14ed670f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264080.624334:0:6467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789264080.624346:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 000000006a3a7d9b/0xecaf9f2f14ed670f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.624364:0:6467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 000000006a3a7d9b/0xecaf9f2f14ed670f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264080.624371:0:6467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789264080.624374:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789264080.624378:0:6467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c3a89eb9800 10000000:01000000:3.0:1789264080.624381:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789264080.624383:0:6467:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789264080.624385:0:6467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789264080.624398:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.624405:0:6467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.624411:0:6467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264080.624422:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322667776:0@lo:101: 00000100:00100000:3.0:1789264080.624447:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264080.624469:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cebb56b going to sleep for 11 seconds 00000100:00100000:0.0:1789264080.624525:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322667776 00000100:00100000:0.0:1789264080.624534:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322667776 00000100:00100000:0.0:1789264080.624670:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789264080.624678:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000519295cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+7:6467:x1876179322667776:12345-0@lo:101: 00010000:00010000:0.0:1789264080.624685:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264080.624693:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002438a479/0xecaf9f2f14ed6724 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed671d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.624867:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002438a479/0xecaf9f2f14ed6724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed671d expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.624875:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002438a479/0xecaf9f2f14ed6724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed671d expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.624881:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002438a479, rc 0) 00000100:00100000:0.0:1789264080.624951:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000519295cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+8:6467:x1876179322667776:12345-0@lo:101: Request processed in 275us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264080.624957:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789264080.625105:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322667776:0@lo:101: 00010000:00010000:3.0:1789264080.625117:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6724 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.625125:0:6467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6724 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264080.625241:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322667904:0@lo:501: 00000100:00100000:3.0:1789264080.625265:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264080.625329:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cebb56b going to sleep for 11 seconds 00000100:00100000:0.0:1789264080.625393:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322667904 00000100:00100000:0.0:1789264080.625397:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322667904 00000100:00100000:0.0:1789264080.625467:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789264080.625475:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df3cc76a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+8:6467:x1876179322667904:12345-0@lo:501: 00000100:00100000:0.0:1789264080.625599:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df3cc76a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+9:6467:x1876179322667904:12345-0@lo:501: Request processed in 124us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264080.625606:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789264080.625667:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322667904:0@lo:501: 00000100:00100000:3.0:1789264080.625693:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322668032:0@lo:503: 00000100:00100000:3.0:1789264080.625764:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264080.626139:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cebb56b going to sleep for 11 seconds 00000100:00100000:2.0:1789264080.626289:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322668032 00000100:00100000:2.0:1789264080.626294:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322668032 00000100:00100000:2.0:1789264080.626319:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789264080.626325:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a85d0ae0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+9:6467:x1876179322668032:12345-0@lo:503: 00000100:00100000:2.0:1789264080.626409:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a85d0ae0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+9:6467:x1876179322668032:12345-0@lo:503: Request processed in 85us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264080.626422:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789264080.626521:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322668032:0@lo:503: 00000100:00100000:2.0:1789264080.627255:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c8702d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6512:1876179322668160:0@lo:502: 00000100:00100000:2.0:1789264080.627304:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264080.627335:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set 000000009bbfc269 going to sleep for 11 seconds 00000100:00100000:0.0:1789264080.627382:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322668160 00000100:00100000:0.0:1789264080.627387:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322668160 00000100:00100000:0.0:1789264080.627422:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264080.627429:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f82c71d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+9:6512:x1876179322668160:12345-0@lo:502: 00000100:00100000:0.0:1789264080.627533:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f82c71d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+9:6512:x1876179322668160:12345-0@lo:502: Request processed in 104us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264080.627547:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789264080.627839:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c8702d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6512:1876179322668160:0@lo:502: 00000020:01000000:1.0:1789264080.627869:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789264080.627880:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264080.627883:0:6512:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789264080.627887:0:6512:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789264080.627891:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789264080.627909:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001429bcbe) 00000020:00000080:1.0:1789264080.627925:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789264080.627931:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789264080.628044:0:6512:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789264080.628050:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed6732 00000020:00000080:1.0:1789264080.628327:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789264080.628331:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264080.628334:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264080.628336:0:6512:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789264080.628338:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789264080.628341:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264080.628343:0:6512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789264080.628345:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789264080.628351:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000272be4fb) 00000020:00000080:1.0:1789264080.628359:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789264080.628362:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789264080.628363:0:6512:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789264080.628365:0:6512:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789264080.628370:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789264080.628407:0:6512:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fc976304 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789264080.628415:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000066919509) 00000020:00000080:1.0:1789264080.628421:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789264080.628476:0:6512:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789264080.628482:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xecaf9f2f14ed6747 00000020:00000080:1.0:1789264080.628649:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789264080.628660:0:6512:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789264080.628665:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xecaf9f2f14ed674e 00080000:01000000:1.0:1789264080.628669:0:6512:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789264080.628673:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed6755 00080000:10000000:0.0:1789264080.629652:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1789264080.630123:0:6512:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789264080.636291:0:6512:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789264080.692475:0:6512:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789264080.693019:0:6512:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789264080.696085:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789264080.696454:0:6512:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789264080.703105:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000659c2a12) 00000020:00000080:2.0:1789264080.703124:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789264080.703210:0:6512:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789264080.703218:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed6763 00000020:00000080:3.0:1789264080.704266:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789264080.706221:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1789264080.710316:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1789264080.712375:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1789264080.718179:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1789264080.720399:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1789264080.722260:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1789264080.723695:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xecaf9f2f14ed676a 00000020:00000080:3.0:1789264080.724083:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789264080.724102:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264080.724107:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264080.724109:0:6512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789264080.724112:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264080.724116:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264080.724117:0:6512:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789264080.724120:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789264080.724121:0:6512:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789264080.724123:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264080.724131:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264080.724132:0:6512:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789264080.724135:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264080.724140:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264080.724141:0:6512:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789264080.724145:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789264080.724181:0:6512:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1789264080.724235:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6512:1876179322668288:0@lo:502: 00000100:00100000:3.0:1789264080.724309:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264080.724365:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3fcffe1 going to sleep for 11 seconds 00000100:00100000:2.0:1789264080.724420:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322668288 00000100:00100000:2.0:1789264080.724427:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322668288 00000100:00100000:2.0:1789264080.724464:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789264080.724473:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8861c7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+9:6512:x1876179322668288:12345-0@lo:502: 00000100:00100000:2.0:1789264080.724591:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8861c7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+9:6512:x1876179322668288:12345-0@lo:502: Request processed in 120us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264080.724598:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789264080.724681:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6512:1876179322668288:0@lo:502: 00000020:01000000:3.0:1789264080.724708:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264080.724712:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264080.724713:0:6512:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789264080.724716:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789264080.724919:0:6467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789264080.724939:0:6467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789264080.724958:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6724 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.724968:0:6467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6724 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264080.724976:0:6467:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c3a89eb9800 from 1 10000000:01000000:2.0:1789264080.724984:0:6467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789264080.725008:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.725016:0:6467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.725028:0:6467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264080.725043:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db667278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322668416:0@lo:101: 00000100:00100000:2.0:1789264080.725073:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264080.725137:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a9f9946 going to sleep for 11 seconds 00000100:00100000:0.0:1789264080.725259:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322668416 00000100:00100000:0.0:1789264080.725265:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322668416 00000100:00100000:0.0:1789264080.725327:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789264080.725334:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d781a8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+9:6467:x1876179322668416:12345-0@lo:101: 00010000:00010000:0.0:1789264080.725343:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264080.725354:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b8932a83/0xecaf9f2f14ed6778 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6771 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.725371:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b8932a83/0xecaf9f2f14ed6778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6771 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.725380:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b8932a83/0xecaf9f2f14ed6778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6771 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.725388:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b8932a83, rc 0) 00000100:00100000:0.0:1789264080.725430:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d781a8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+10:6467:x1876179322668416:12345-0@lo:101: Request processed in 97us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264080.725436:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789264080.725493:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db667278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322668416:0@lo:101: 00010000:00010000:3.0:1789264080.725515:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6778 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.725523:0:6467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6778 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264080.726064:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322668544:0@lo:256: 00000100:00100000:3.0:1789264080.726116:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264080.726313:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3fcffe1 going to sleep for 11 seconds 00000100:00100000:2.0:1789264080.726355:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322668544 00000100:00100000:2.0:1789264080.726360:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322668544 00000100:00100000:2.0:1789264080.726383:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789264080.726390:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048e35bee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+10:6467:x1876179322668544:12345-0@lo:256: 20000000:01000000:2.0:1789264080.726402:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789264080.726407:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789264080.726571:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048e35bee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+10:6467:x1876179322668544:12345-0@lo:256: Request processed in 182us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264080.726578:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789264080.726663:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322668544:0@lo:256: 10000000:01000000:3.0:1789264080.728008:0:6467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789264080.728069:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6778 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.728664:0:6467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6778 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264080.728673:0:6467:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3a89eb9800 from 1 10000000:01000000:3.0:1789264080.728675:0:6467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789264080.728708:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.728714:0:6467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.728722:0:6467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264080.728738:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322668672:0@lo:101: 00000100:00100000:3.0:1789264080.728814:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264080.728853:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3fcffe1 going to sleep for 11 seconds 00000100:00100000:1.0:1789264080.728906:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322668672 00000100:00100000:1.0:1789264080.728914:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322668672 00000100:00100000:1.0:1789264080.728973:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789264080.728982:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d7552af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+10:6467:x1876179322668672:12345-0@lo:101: 00010000:00010000:1.0:1789264080.728994:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264080.729006:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000059535474/0xecaf9f2f14ed6786 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed677f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264080.729026:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000059535474/0xecaf9f2f14ed6786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed677f expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264080.729037:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000059535474/0xecaf9f2f14ed6786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed677f expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264080.729045:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000059535474, rc 0) 00000100:00100000:1.0:1789264080.729130:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d7552af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:6467:x1876179322668672:12345-0@lo:101: Request processed in 149us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264080.729137:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789264080.729165:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322668672:0@lo:101: 00010000:00010000:3.0:1789264080.729180:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6786 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.729187:0:6467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6786 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264080.729235:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322668800:0@lo:501: 00000100:00100000:3.0:1789264080.729258:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264080.729284:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3fcffe1 going to sleep for 11 seconds 00000100:00100000:1.0:1789264080.729729:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322668800 00000100:00100000:1.0:1789264080.729734:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322668800 00000100:00100000:1.0:1789264080.729775:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789264080.729782:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6740a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:6467:x1876179322668800:12345-0@lo:501: 00000100:00100000:1.0:1789264080.729939:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6740a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:6467:x1876179322668800:12345-0@lo:501: Request processed in 158us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264080.729946:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789264080.730019:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322668800:0@lo:501: 00000100:00100000:3.0:1789264080.730046:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322668928:0@lo:503: 00000100:00100000:3.0:1789264080.730082:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264080.730116:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3fcffe1 going to sleep for 11 seconds 00000100:00100000:2.0:1789264080.730208:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322668928 00000100:00100000:2.0:1789264080.730212:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322668928 00000100:00100000:2.0:1789264080.730245:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789264080.730251:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d18b5e03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:6467:x1876179322668928:12345-0@lo:503: 00000040:00080000:2.0:1789264080.730280:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789264080.730326:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d18b5e03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:6467:x1876179322668928:12345-0@lo:503: Request processed in 76us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264080.730342:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789264080.730438:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbf11b08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322668928:0@lo:503: 00000040:00080000:0.0:1789264080.731448:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789264080.731614:0:6467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789264080.731641:0:6467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789264080.731685:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6786 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264080.731694:0:6467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6786 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264080.731739:0:6467:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789264080.731764:0:6467:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c3a89eb9800 10000000:01000000:1.0:1789264080.731768:0:6467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c3a89eb9800 10000000:01000000:1.0:1789264080.731771:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789264080.731776:0:6467:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3a89eb9800 from 1 10000000:01000000:1.0:1789264080.731779:0:6467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789264080.731814:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264080.731821:0:6467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264080.731829:0:6467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264080.731845:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032fc578d pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322669056:0@lo:101: 00000100:00100000:1.0:1789264080.731882:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264080.731916:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093d9a9d6 going to sleep for 11 seconds 00000100:00100000:2.0:1789264080.732005:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322669056 00000100:00100000:2.0:1789264080.732010:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322669056 00000100:00100000:2.0:1789264080.732047:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789264080.732054:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1a8eb0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:6467:x1876179322669056:12345-0@lo:101: 00010000:00010000:2.0:1789264080.732063:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264080.732072:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b92affd6/0xecaf9f2f14ed6794 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed678d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.732100:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b92affd6/0xecaf9f2f14ed6794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed678d expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.732109:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b92affd6/0xecaf9f2f14ed6794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed678d expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.732116:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b92affd6, rc 0) 00000100:00100000:2.0:1789264080.732155:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1a8eb0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6467:x1876179322669056:12345-0@lo:101: Request processed in 102us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264080.732162:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789264080.732228:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032fc578d pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322669056:0@lo:101: 00010000:00010000:3.0:1789264080.732240:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6794 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.732247:0:6467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6794 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264080.732289:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3c55d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322669184:0@lo:501: 00000100:00100000:3.0:1789264080.732314:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264080.732341:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 000000009bac5014 going to sleep for 11 seconds 00000100:00100000:1.0:1789264080.732382:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322669184 00000100:00100000:1.0:1789264080.732387:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322669184 00000100:00100000:1.0:1789264080.732415:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789264080.732422:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f36c47a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6467:x1876179322669184:12345-0@lo:501: 00000100:00100000:1.0:1789264080.732518:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f36c47a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6467:x1876179322669184:12345-0@lo:501: Request processed in 98us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264080.732530:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789264080.732599:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3c55d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322669184:0@lo:501: 00000100:00100000:3.0:1789264080.732623:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3c55d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322669312:0@lo:503: 00000100:00100000:3.0:1789264080.732653:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264080.732669:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 000000009bac5014 going to sleep for 11 seconds 00000100:00100000:2.0:1789264080.732885:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322669312 00000100:00100000:2.0:1789264080.732890:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322669312 00000100:00100000:2.0:1789264080.732919:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789264080.732926:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b55da451 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6467:x1876179322669312:12345-0@lo:503: 00000100:00100000:2.0:1789264080.733003:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b55da451 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6467:x1876179322669312:12345-0@lo:503: Request processed in 78us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264080.733009:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789264080.733038:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3c55d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322669312:0@lo:503: 00000100:00100000:1.0:1789264080.733641:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000add96240 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6517:1876179322669440:0@lo:502: 00000100:00100000:1.0:1789264080.733681:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264080.733714:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dca371d6 going to sleep for 11 seconds 00000100:00100000:0.0:1789264080.733787:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322669440 00000100:00100000:0.0:1789264080.733794:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322669440 00000100:00100000:0.0:1789264080.733836:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789264080.733845:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095bad650 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6517:x1876179322669440:12345-0@lo:502: 00000100:00100000:0.0:1789264080.733946:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095bad650 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6517:x1876179322669440:12345-0@lo:502: Request processed in 103us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264080.733953:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789264080.734130:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000add96240 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6517:1876179322669440:0@lo:502: 00000020:01000004:1.0:1789264080.734186:0:6517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789264080.734199:0:6517:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000018d560cf) 00000020:00000080:1.0:1789264080.734215:0:6517:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1789264080.734300:0:6517:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fc976304 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789264080.734304:0:6517:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000fc976304 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789264080.734306:0:6517:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000fc976304 4 00010000:00080000:1.0:1789264080.734328:0:6517:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000052146280@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:1.0:1789264080.735979:0:6517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789264080.736199:0:6517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789264080.736231:0:6517:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789264080.736241:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xecaf9f2f14ed67a2 00000100:00080000:1.0:1789264080.736259:0:6517:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789264080.736264:0:6517:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000052146280 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264080.736293:0:6517:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000add96240 x1876179322669568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789264080.736323:0:6517:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789264080.736398:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000add96240 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876179322669568:0@lo:38: 00000100:00100000:3.0:1789264080.736455:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264080.736534:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322669568 00000100:00100000:0.0:1789264080.736541:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322669568 00000100:00100000:0.0:1789264080.736576:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789264080.736582:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082f63e88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1876179322669568:12345-0@lo:38: 00000100:00100000:0.0:1789264080.736641:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082f63e88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1876179322669568:12345-0@lo:38: Request processed in 58us (186us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789264080.736649:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789264080.736847:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789264080.736853:0:3621:0:(import.c:65:import_set_state_nolock()) 0000000052146280 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789264080.736858:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789264080.736860:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000add96240 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876179322669568:0@lo:38: 00000100:00100000:2.0:1789264080.738486:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000098c3516 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6517:1876179322669696:0@lo:502: 00000100:00100000:2.0:1789264080.738558:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264080.738596:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2d60b61 going to sleep for 11 seconds 00000100:00100000:0.0:1789264080.739772:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322669696 00000100:00100000:0.0:1789264080.739781:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322669696 00000100:00100000:0.0:1789264080.739827:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789264080.739835:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee71f8fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6517:x1876179322669696:12345-0@lo:502: 00000100:00100000:0.0:1789264080.739954:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee71f8fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6517:x1876179322669696:12345-0@lo:502: Request processed in 120us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264080.739963:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789264080.740544:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000098c3516 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6517:1876179322669696:0@lo:502: 00000040:00080000:2.0:1789264080.740572:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789264080.740790:0:6467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789264080.740814:0:6467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789264080.740832:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6794 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264080.740842:0:6467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6794 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789264080.740887:0:6467:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789264080.740893:0:6467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789264080.740895:0:6467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264080.740896:0:6467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789264080.740897:0:6467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264080.740898:0:6467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264080.740900:0:6467:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789264080.740901:0:6467:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789264080.740902:0:6467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789264080.740903:0:6467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789264080.740904:0:6467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264080.740905:0:6467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789264080.740908:0:6467:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789264080.740911:0:6467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789264080.740912:0:6467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789264080.740913:0:6467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264080.740915:0:6467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789264080.740916:0:6467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264080.740917:0:6467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264080.740918:0:6467:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789264080.740919:0:6467:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789264080.740919:0:6467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789264080.740920:0:6467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789264080.740921:0:6467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264080.740922:0:6467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789264080.740938:0:6467:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789264080.740950:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000692f403f pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322669824:0@lo:253: 00000100:00100000:0.0:1789264080.740989:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264080.741024:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set 000000006da1dc40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264080.741246:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322669824 00000100:00100000:3.0:1789264080.741253:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322669824 00000100:00100000:3.0:1789264080.741286:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789264080.741292:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c74a7a5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6467:x1876179322669824:12345-0@lo:253: 20000000:01000000:3.0:1789264080.741312:0:6485:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789264080.741323:0:6485:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789264080.746617:0:6485:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789264080.746631:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789264080.746712:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789264080.746716:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789264080.746730:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.746991:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b8932a83/0xecaf9f2f14ed6778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6771 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.746997:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.747024:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b8932a83/0xecaf9f2f14ed6778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6771 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.747034:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b8932a83/0xecaf9f2f14ed6778 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6771 expref: 12 pid: 6482 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264080.747043:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000098c3516 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876179322669952:0@lo:104: 00000100:00100000:2.0:1789264080.747072:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264080.747101:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2d60b61 going to sleep for 11 seconds 00000100:00100000:2.0:1789264080.747119:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322669952 00000100:00100000:2.0:1789264080.747124:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322669952 00000100:00100000:2.0:1789264080.747160:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789264080.747166:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003714be3f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:6506:x1876179322669952:12345-0@lo:104: 00010000:00010000:2.0:1789264080.747176:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6778 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.747237:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789264080.747245:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003714be3f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:6506:x1876179322669952:12345-0@lo:104: Request processed in 79us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264080.747251:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789264080.747253:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000098c3516 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876179322669952:0@lo:104: 00010000:00010000:3.0:1789264080.747273:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747292:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264080.747296:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6778 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747303:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003f9bdd79 already unused, calling callback (00000000413e4e27) 10000000:00010000:3.0:1789264080.747306:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6778 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747313:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6778 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264080.747320:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c74a7a5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6467:x1876179322669824:12345-0@lo:253: Request processed in 6025us (6329us total) trans 0 rc 0/0 10000000:00010000:3.0:1789264080.747322:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6778 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264080.747332:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1789264080.747333:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1789264080.747368:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6778 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747375:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789264080.747398:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6778 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747404:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 000000003f9bdd79/0xecaf9f2f14ed6771 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6778 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747474:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264080.747476:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264080.747483:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264080.747534:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000094c0c79c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322670080:0@lo:103: 00000100:00100000:0.0:1789264080.747557:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264080.747594:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322670080 00000100:00100000:3.0:1789264080.747599:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322670080 00000100:00100000:1.0:1789264080.747604:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000692f403f pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6467:1876179322669824:0@lo:253: 00010000:00010000:3.0:1789264080.747616:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b8932a83/0xecaf9f2f14ed6778 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6771 expref: 12 pid: 6482 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264080.747617:0:6467:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789264080.747620:0:6467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789264080.747622:0:6467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789264080.747624:0:6467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789264080.747626:0:6467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789264080.747627:0:6467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789264080.747629:0:6467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789264080.747631:0:6467:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789264080.747633:0:6467:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789264080.747634:0:6467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789264080.747635:0:6467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789264080.747636:0:6467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789264080.747636:0:6467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789264080.747646:0:6467:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789264080.747665:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789264080.747672:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2b5c070 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:3623:x1876179322670080:12345-0@lo:103: 00010000:00010000:3.0:1789264080.747681:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264080.747685:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b8932a83/0xecaf9f2f14ed6778 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6771 expref: 12 pid: 6482 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747694:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b8932a83/0xecaf9f2f14ed6778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6771 expref: 12 pid: 6482 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747705:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b8932a83/0xecaf9f2f14ed6778 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6771 expref: 12 pid: 6482 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747880:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747887:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789264080.747899:0:6475:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001183452s 00010000:00010000:3.0:1789264080.747903:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747909:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747915:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747926:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747932:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005495310e already unused, calling callback (00000000fe6a1ae7) 00010000:00010000:3.0:1789264080.747935:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747941:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747958:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264080.747968:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264080.748006:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2b5c070 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:3623:x1876179322670080:12345-0@lo:103: Request processed in 333us (446us total) trans 0 rc 0/0 00010000:00010000:2.0:1789264080.748006:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264080.748019:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264080.748020:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789264080.748027:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005495310e/0xecaf9f2f14ed67a9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264080.748081:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000094c0c79c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322670080:0@lo:103: 00080000:10000000:1.0:1789264080.751858:0:6467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1789264080.752072:0:6467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789264080.752284:0:6467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1789264080.752438:0:6467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789264080.752606:0:6467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1789264080.752706:0:6467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789264080.753217:0:6467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1789264080.753378:0:6467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1789264080.753559:0:6467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1789264080.753706:0:6467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1789264080.753929:0:6467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1789264080.754085:0:6467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1789264080.756080:0:6467:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789264080.762601:0:6467:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789264080.762725:0:6522:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789264080.762729:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789264080.764012:0:6523:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:2.0:1789264080.765729:0:6523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789264080.765827:0:6467:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789264080.766028:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789264080.766512:0:6467:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789264080.766519:0:6467:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789264080.766675:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789264080.767985:0:6467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789264080.768645:0:6467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789264080.768675:0:6467:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789264080.768860:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789264080.769151:0:6467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1789264080.770034:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789264080.770173:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789264080.770329:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789264080.770457:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789264080.770598:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789264080.770728:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789264080.770956:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789264080.771097:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789264080.771237:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789264080.771375:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789264080.771543:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000040:00080000:2.0:1789264080.771573:0:6523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789264080.771640:0:6523:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789264080.771644:0:6523:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1789264080.771713:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789264080.771952:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789264080.772099:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789264080.772265:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789264080.772392:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789264080.772660:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789264080.772921:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789264080.773087:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789264080.773219:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789264080.773346:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789264080.773508:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789264080.773645:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789264080.773874:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789264080.774008:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789264080.774155:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789264080.774286:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789264080.774430:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789264080.774625:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789264080.774950:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789264080.775069:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789264080.775188:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789264080.775346:0:6467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1789264080.779139:0:6467:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789264080.779179:0:6467:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb65101cbb988 00100000:10000000:0.0:1789264080.779186:0:6467:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789264080.779488:0:6467:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789264080.779516:0:6467:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789264080.779537:0:6467:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1789264080.779613:0:6467:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789264080.782178:0:6467:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789264080.782709:0:6467:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789264081.545895:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264082.569859:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789264082.895233:0:6768:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:2.0:1789264083.391295:0:6820:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789264083.391592:0:6820:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789264083.594237:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264084.618204:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789264085.493518:0:6921:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789264085.493740:0:6921:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789264085.642141:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789264086.025867:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789264086.025878:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789264086.025880:0:36:0:(import.c:65:import_set_state_nolock()) 0000000052146280 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789264086.025892:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000052146280 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1789264086.025910:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000112c93e4 x1876179322670336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789264086.025946:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000112c93e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876179322670336:0@lo:38: 00000100:00100000:3.0:1789264086.026002:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264086.026069:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322670336 00000100:00100000:3.0:1789264086.026081:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322670336 00000100:00100000:3.0:1789264086.026119:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789264086.026124:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005dd0dc0d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1876179322670336:12345-0@lo:38: 00010000:00080000:3.0:1789264086.026146:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:3.0:1789264086.026176:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xecaf9f2f14ed67b0 00000004:00100000:3.0:1789264086.026244:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789264086.026348:0:6492:0:(import.c:65:import_set_state_nolock()) 00000000e3c519e9 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789264086.026393:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005dd0dc0d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876179322670336:12345-0@lo:38: Request processed in 267us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264086.026400:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789264086.026435:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000112c93e4 x1876179322670336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789264096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789264086.026448:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789264086.026454:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789264086.026467:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789264086.026469:0:3621:0:(import.c:65:import_set_state_nolock()) 0000000052146280 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789264086.026475:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000112c93e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876179322670336:0@lo:38: 00000100:00100000:0.0:1789264086.026591:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d1f83ab0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322670208:0@lo:400: 00000100:00100000:0.0:1789264086.026624:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264086.026835:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322670208 00000100:00100000:3.0:1789264086.026840:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322670208 00000100:00100000:3.0:1789264086.026878:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789264086.026885:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fed0f30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:3624:x1876179322670208:12345-0@lo:400: 00000100:00100000:3.0:1789264086.026959:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fed0f30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:3624:x1876179322670208:12345-0@lo:400: Request processed in 74us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264086.026965:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789264086.030501:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d1f83ab0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322670208:0@lo:400: 00010000:00010000:1.0:1789264086.666499:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264087.690003:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264088.716964:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789264089.610123:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789264089.610129:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c3a89eb9800 from 3 10000000:01000000:3.0:1789264089.610133:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789264089.610339:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264089.610351:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264089.610362:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264089.610455:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000112c93e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322670464:0@lo:101: 00000100:00100000:3.0:1789264089.610520:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264089.610612:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002f74822 going to sleep for 11 seconds 00000100:00100000:0.0:1789264089.613226:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322670464 00000100:00100000:0.0:1789264089.613242:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322670464 00000100:00100000:0.0:1789264089.613479:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789264089.613488:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083ce531f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:6487:x1876179322670464:12345-0@lo:101: 00010000:00010000:0.0:1789264089.613504:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264089.613521:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fe411be0/0xecaf9f2f14ed67be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed67b7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264089.613546:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe411be0/0xecaf9f2f14ed67be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed67b7 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264089.613559:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fe411be0/0xecaf9f2f14ed67be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed67b7 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264089.613568:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fe411be0, rc 0) 00000100:00100000:0.0:1789264089.613818:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083ce531f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6487:x1876179322670464:12345-0@lo:101: Request processed in 331us (3298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264089.613825:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789264089.613988:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000112c93e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322670464:0@lo:101: 00010000:00010000:2.0:1789264089.614005:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed67be expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264089.614015:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed67be expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264089.614073:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000029ee804a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322670592:0@lo:256: 00000100:00100000:2.0:1789264089.614119:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264089.614158:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072123274 going to sleep for 11 seconds 00000100:00100000:0.0:1789264089.614159:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322670592 00000100:00100000:0.0:1789264089.614336:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322670592 00000100:00100000:0.0:1789264089.614640:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789264089.614648:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3fb1a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6487:x1876179322670592:12345-0@lo:256: 20000000:01000000:0.0:1789264089.614664:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789264089.614680:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789264089.614683:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789264089.614794:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3fb1a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6487:x1876179322670592:12345-0@lo:256: Request processed in 147us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264089.614801:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789264089.614852:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000029ee804a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322670592:0@lo:256: 10000000:01000000:3.0:1789264089.615167:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789264089.615175:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed67be expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264089.615183:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed67be expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264089.738977:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264090.769720:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264091.146534:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789264091.146558:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d47026b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322670720:0@lo:400: 00000100:00100000:3.0:1789264091.146626:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264091.146949:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0862724 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322670848:0@lo:400: 00000100:00100000:3.0:1789264091.146978:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264091.147013:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322670720 00000100:00100000:3.0:1789264091.147019:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322670720 00000100:00100000:3.0:1789264091.147061:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789264091.147069:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b66e1ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:3624:x1876179322670720:12345-0@lo:400: 00000100:00100000:3.0:1789264091.147119:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b66e1ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:3624:x1876179322670720:12345-0@lo:400: Request processed in 51us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.147127:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789264091.147157:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322670848 00000100:00100000:3.0:1789264091.147160:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322670848 00000100:00100000:3.0:1789264091.147184:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789264091.147191:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f52dcad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322670848:12345-0@lo:400: 00000100:00100000:3.0:1789264091.147225:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f52dcad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322670848:12345-0@lo:400: Request processed in 35us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.147232:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789264091.147265:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a0862724 x1876179322670848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264091.147288:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0862724 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322670848:0@lo:400: 00000100:00100000:3.0:1789264091.147317:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d47026b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322670720:0@lo:400: 00000020:01000004:1.0:1789264091.614707:0:7419:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789264091.614712:0:7419:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789264091.614713:0:7419:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789264091.614865:0:7419:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000b33807e7 00000020:01000004:1.0:1789264091.614882:0:7419:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1789264091.614891:0:7419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789264091.614912:0:7419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000650f5acf) 00000020:00000080:1.0:1789264091.614928:0:7419:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789264091.660372:0:7419:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789264091.660445:0:7419:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1789264091.688164:0:7419:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789264091.688386:0:7419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789264091.688397:0:7419:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789264091.688409:0:7419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xecaf9f2f14ed67cc 00000020:01000004:3.0:1789264091.688416:0:7419:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789264091.688446:0:7419:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.144@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789264091.688449:0:7419:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789264091.688456:0:7419:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789264091.688482:0:7419:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789264091.688487:0:7419:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789264091.707903:0:7419:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789264091.707942:0:7419:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.144@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1789264091.707947:0:7419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789264091.707949:0:7419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789264091.707950:0:7419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789264091.707951:0:7419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789264091.707952:0:7419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789264091.707954:0:7419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789264091.707955:0:7419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789264091.707957:0:7419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789264091.707958:0:7419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789264091.707959:0:7419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789264091.707960:0:7419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789264091.707964:0:7419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1789264091.707966:0:7419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789264091.707967:0:7419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789264091.707968:0:7419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789264091.707969:0:7419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789264091.707970:0:7419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789264091.707971:0:7419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789264091.707971:0:7419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789264091.707972:0:7419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789264091.707973:0:7419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789264091.707974:0:7419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789264091.707975:0:7419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789264091.708001:0:7419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789264091.708090:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322670976:0@lo:253: 00000100:00100000:2.0:1789264091.708165:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.708280:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f3ab8ec going to sleep for 11 seconds 00000100:00100000:0.0:1789264091.708364:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322670976 00000100:00100000:0.0:1789264091.708373:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322670976 00000100:00100000:0.0:1789264091.708465:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789264091.708474:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058aff604 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:7419:x1876179322670976:12345-0@lo:253: 20000000:01000000:0.0:1789264091.708504:0:6482:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789264091.708509:0:6482:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1789264091.708514:0:6482:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1789264091.708517:0:6482:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1789264091.708548:0:6482:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1789264091.708716:0:6482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789264091.708868:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789264091.708883:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789264091.708899:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789264091.708913:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789264091.708926:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789264091.708979:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1789264091.708986:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1789264091.708997:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1789264091.709002:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1789264091.709214:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1789264091.709230:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1789264091.709246:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789264091.709260:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789264091.709359:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1789264091.709369:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:0.0:1789264091.709382:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1789264091.709387:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789264091.709400:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1789264091.709406:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:0.0:1789264091.709430:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1789264091.709438:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789264091.709452:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789264091.709468:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789264091.709479:0:6482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789264091.709568:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1789264091.709577:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1789264091.709592:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789264091.709609:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789264091.709628:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1789264091.709634:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1789264091.709647:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789264091.709667:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789264091.709673:0:6482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1789264091.709693:0:6482:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789264091.709700:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1789264091.710093:0:7425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789264091.710236:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789264091.710255:0:6482:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.144@tcp for mdt 20000000:01000000:0.0:1789264091.710257:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:0.0:1789264091.710272:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789264091.710277:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789264091.710301:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789264091.710308:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:0.0:1789264091.710327:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789264091.710334:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1789264091.710346:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1789264091.710360:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1789264091.710399:0:6482:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1789264091.710407:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1789264091.711212:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1789264091.711558:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789264091.711590:0:6482:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.144@tcp for mdt 20000000:01000000:0.0:1789264091.711593:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:0.0:1789264091.711610:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789264091.711617:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789264091.711631:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789264091.711637:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:0.0:1789264091.711649:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789264091.711656:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1789264091.711688:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789264091.711705:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1789264091.711725:0:6482:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789264091.711728:0:6482:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789264091.711731:0:6482:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789264091.711832:0:6482:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789264091.711835:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789264091.713498:0:7427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789264091.713541:0:7427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789264091.713559:0:7427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789264091.713998:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789264091.714022:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789264091.714039:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789264091.714048:0:6482:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789264091.714049:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789264091.714390:0:7428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789264091.714410:0:7428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789264091.714440:0:7428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789264091.714569:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789264091.714589:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789264091.714629:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789264091.714651:0:6482:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789264091.714653:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789264091.715158:0:7429:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789264091.715180:0:7429:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789264091.715198:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789264091.715355:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1789264091.715377:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1789264091.715390:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1789264091.715404:0:6482:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789264091.715406:0:6482:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789264091.715411:0:6482:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789264091.715417:0:6482:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789264091.716105:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1789264091.716249:0:6482:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789264091.727862:0:6482:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789264091.728001:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.728030:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000640af581/0xecaf9f2f14ed6708 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6701 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.728037:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002438a479/0xecaf9f2f14ed6724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed671d expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.728043:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b92affd6/0xecaf9f2f14ed6794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed678d expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.728050:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.728091:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b92affd6/0xecaf9f2f14ed6794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed678d expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.728105:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b92affd6/0xecaf9f2f14ed6794 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed678d expref: 12 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264091.728119:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000add96240 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322671104:0@lo:104: 00000100:00100000:1.0:1789264091.728181:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789264091.728246:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002438a479/0xecaf9f2f14ed6724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed671d expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.728268:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002438a479/0xecaf9f2f14ed6724 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed671d expref: 12 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264091.728274:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322671104 00000100:00100000:1.0:1789264091.728276:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000601c8559 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322671232:0@lo:104: 00000100:00100000:3.0:1789264091.728280:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322671104 00000100:00100000:1.0:1789264091.728299:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789264091.728362:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000640af581/0xecaf9f2f14ed6708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6701 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.728370:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000640af581/0xecaf9f2f14ed6708 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6701 expref: 12 pid: 6484 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264091.728378:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084941411 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322671360:0@lo:104: 00000100:00100000:1.0:1789264091.728400:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264091.729178:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 000000004868e0d0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264091.729328:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322671232 00000100:00100000:0.0:1789264091.729335:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322671232 00000100:00100000:0.0:1789264091.729360:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322671360 00000100:00100000:0.0:1789264091.729362:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322671360 00000100:00100000:0.0:1789264091.729377:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789264091.729384:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7b0b228 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:6482:x1876179322671104:12345-0@lo:104: 00010000:00010000:0.0:1789264091.729396:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6794 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.729514:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789264091.729519:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7b0b228 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:6482:x1876179322671104:12345-0@lo:104: Request processed in 136us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264091.729526:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789264091.729543:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264091.729548:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df088071 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:6482:x1876179322671232:12345-0@lo:104: 00010000:00010000:0.0:1789264091.729554:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6724 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.729596:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789264091.729601:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df088071 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:6482:x1876179322671232:12345-0@lo:104: Request processed in 54us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264091.729607:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264091.729620:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789264091.729625:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aec45dfa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:6482:x1876179322671360:12345-0@lo:104: 00010000:00010000:0.0:1789264091.729631:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6708 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.729655:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789264091.729659:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aec45dfa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:6482:x1876179322671360:12345-0@lo:104: Request processed in 35us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264091.729665:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789264091.729863:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789264091.729868:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6794 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.729876:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000dd6ca73 already unused, calling callback (00000000413e4e27) 10000000:00010000:0.0:1789264091.729879:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6794 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.729886:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6794 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264091.729892:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6794 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264091.729896:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789264091.729933:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6794 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.729940:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264091.729956:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6794 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.729964:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 000000000dd6ca73/0xecaf9f2f14ed678d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6794 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.729977:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789264091.729979:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6724 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.729984:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b5ce68ce already unused, calling callback (00000000413e4e27) 10000000:00010000:0.0:1789264091.729986:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6724 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.729991:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6724 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264091.729996:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6724 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264091.730001:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789264091.730012:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6724 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.730162:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264091.730205:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264091.730224:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6724 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.730241:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 00000000b5ce68ce/0xecaf9f2f14ed671d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6724 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.730253:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264091.730254:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264091.730256:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264091.730276:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000216c0438 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322671488:0@lo:103: 00000100:00100000:0.0:1789264091.730313:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264091.730374:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789264091.730381:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c06972f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322671616:0@lo:103: 00000100:00100000:0.0:1789264091.730402:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264091.730444:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322671488 00000100:00100000:0.0:1789264091.730449:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322671488 00010000:00010000:0.0:1789264091.730467:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b92affd6/0xecaf9f2f14ed6794 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed678d expref: 13 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264091.730487:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322671616 00000100:00100000:0.0:1789264091.730490:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322671616 00010000:00010000:0.0:1789264091.730501:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002438a479/0xecaf9f2f14ed6724 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed671d expref: 14 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264091.730513:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789264091.730519:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000354fea25 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:3623:x1876179322671488:12345-0@lo:103: 00010000:00010000:0.0:1789264091.730530:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264091.730534:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b92affd6/0xecaf9f2f14ed6794 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed678d expref: 14 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.730543:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b92affd6/0xecaf9f2f14ed6794 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed678d expref: 14 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.730567:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264091.730596:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000354fea25 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:3623:x1876179322671488:12345-0@lo:103: Request processed in 77us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264091.730603:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789264091.730618:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264091.730623:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001eb7f853 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:3625:x1876179322671616:12345-0@lo:103: 00010000:00010000:0.0:1789264091.730630:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264091.730633:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002438a479/0xecaf9f2f14ed6724 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed671d expref: 13 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.730641:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002438a479/0xecaf9f2f14ed6724 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed671d expref: 13 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.730650:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264091.730673:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001eb7f853 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:3625:x1876179322671616:12345-0@lo:103: Request processed in 50us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264091.730847:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264091.730887:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000216c0438 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322671488:0@lo:103: 00000100:00100000:0.0:1789264091.730911:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c06972f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322671616:0@lo:103: 00010000:00010000:1.0:1789264091.731025:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b92affd6/0xecaf9f2f14ed6794 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed678d expref: 12 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264091.731037:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000add96240 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322671104:0@lo:104: 00010000:00010000:1.0:1789264091.731662:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002438a479/0xecaf9f2f14ed6724 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed671d expref: 11 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264091.731675:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000601c8559 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322671232:0@lo:104: 00000100:00100000:1.0:1789264091.731696:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084941411 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322671360:0@lo:104: 00010000:00010000:1.0:1789264091.731717:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.732003:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264091.732006:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264091.732008:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264091.732103:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6708 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732119:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000392711a3 already unused, calling callback (00000000413e4e27) 10000000:00010000:1.0:1789264091.732122:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6708 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732129:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6708 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264091.732134:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6708 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264091.732140:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789264091.732178:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6708 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732184:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264091.732200:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6708 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732207:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 00000000392711a3/0xecaf9f2f14ed6701 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6708 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732221:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264091.732222:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264091.732224:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264091.732235:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084941411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322671744:0@lo:103: 00000100:00100000:1.0:1789264091.732283:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264091.732325:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322671744 00000100:00100000:1.0:1789264091.732330:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322671744 00010000:00010000:1.0:1789264091.732347:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000640af581/0xecaf9f2f14ed6708 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6701 expref: 11 pid: 6484 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264091.732377:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789264091.732383:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000601c8559 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:3625:x1876179322671744:12345-0@lo:103: 00010000:00010000:1.0:1789264091.732392:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264091.732396:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000640af581/0xecaf9f2f14ed6708 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6701 expref: 11 pid: 6484 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732404:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000640af581/0xecaf9f2f14ed6708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6701 expref: 11 pid: 6484 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732415:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000640af581/0xecaf9f2f14ed6708 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6701 expref: 11 pid: 6484 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732443:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732450:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732462:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732468:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732474:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732479:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732493:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b974b8fb already unused, calling callback (00000000fe6a1ae7) 00010000:00010000:1.0:1789264091.732496:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732502:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732513:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732521:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264091.732548:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000601c8559 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+10:3625:x1876179322671744:12345-0@lo:103: Request processed in 166us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264091.732554:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789264091.732591:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084941411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322671744:0@lo:103: 00010000:00010000:1.0:1789264091.732607:0:6482:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732614:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.732618:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed67d3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789264091.732633:0:6482:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789264091.737147:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058aff604 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+9:7419:x1876179322670976:12345-0@lo:253: Request processed in 28666us (28974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264091.737162:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789264091.737313:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322670976:0@lo:253: 10000000:01000000:2.0:1789264091.737388:0:7419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789264091.737392:0:7419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789264091.737393:0:7419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789264091.737395:0:7419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789264091.737396:0:7419:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1789264091.737397:0:7419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789264091.737398:0:7419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789264091.737399:0:7419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789264091.737401:0:7419:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789264091.737403:0:7419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789264091.737404:0:7419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789264091.737437:0:7419:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b33807e7 from lustre-MDT0001 10000000:01000000:2.0:1789264091.737469:0:7419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789264091.737472:0:7419:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789264091.737478:0:7419:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c3aaa494d28 local copy 10000000:01000000:2.0:1789264091.737482:0:7419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789264091.737516:0:7419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.737527:0:7419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.737535:0:7419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264091.737550:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322671872:0@lo:101: 00000100:00100000:2.0:1789264091.737586:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.737636:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f3ab8ec going to sleep for 11 seconds 00000100:00100000:0.0:1789264091.737695:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322671872 00000100:00100000:0.0:1789264091.737701:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322671872 00000100:00100000:0.0:1789264091.737806:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789264091.737815:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cdfed9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+9:7419:x1876179322671872:12345-0@lo:101: 00010000:00010000:0.0:1789264091.737841:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264091.737853:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058a569c7/0xecaf9f2f14ed67e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed67da expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.737876:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058a569c7/0xecaf9f2f14ed67e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed67da expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.737885:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058a569c7/0xecaf9f2f14ed67e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed67da expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.737893:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058a569c7, rc 0) 00000100:00100000:0.0:1789264091.737926:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cdfed9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+10:7419:x1876179322671872:12345-0@lo:101: Request processed in 112us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264091.737932:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789264091.738020:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322671872:0@lo:101: 00010000:00010000:2.0:1789264091.738038:0:7419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xecaf9f2f14ed67e1 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.738046:0:7419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xecaf9f2f14ed67e1 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264091.738133:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322672000:0@lo:501: 00000100:00100000:2.0:1789264091.738159:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.738381:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f3ab8ec going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.738586:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322672000 00000100:00100000:3.0:1789264091.738592:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322672000 00000100:00100000:3.0:1789264091.738621:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789264091.738627:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009512529d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+10:7419:x1876179322672000:12345-0@lo:501: 00000100:00100000:3.0:1789264091.738700:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009512529d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+10:7419:x1876179322672000:12345-0@lo:501: Request processed in 74us (541us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789264091.738707:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789264091.738782:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322672000:0@lo:501: 10000000:01000000:2.0:1789264091.738794:0:7419:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789264091.738813:0:7419:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789264091.738818:0:7419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xecaf9f2f14ed67e1 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.738826:0:7419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xecaf9f2f14ed67e1 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.738832:0:7419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xecaf9f2f14ed67e1 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.738850:0:7419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789264091.738876:0:7419:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c3aae2b1800 10000000:01000000:2.0:1789264091.738881:0:7419:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789264091.738886:0:7419:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c3aaa494d28 10000000:01000000:2.0:1789264091.738888:0:7419:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789264091.738891:0:7419:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c3aaa494d28 from 1 10000000:01000000:2.0:1789264091.738894:0:7419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789264091.738911:0:7419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000645edddd/0xecaf9f2f14ed67e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.738925:0:7419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000645edddd/0xecaf9f2f14ed67e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.738933:0:7419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000645edddd/0xecaf9f2f14ed67e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264091.738947:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322672128:0@lo:101: 00000100:00100000:2.0:1789264091.738972:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.739005:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074ee3c41 going to sleep for 11 seconds 00000100:00100000:2.0:1789264091.739020:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322672128 00000100:00100000:2.0:1789264091.739023:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322672128 00000100:00100000:2.0:1789264091.739042:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789264091.739047:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab423a1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+10:7419:x1876179322672128:12345-0@lo:101: 00010000:00010000:2.0:1789264091.739054:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264091.739063:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e1a30b7e/0xecaf9f2f14ed67ef lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed67e8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.739077:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e1a30b7e/0xecaf9f2f14ed67ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed67e8 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.739085:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e1a30b7e/0xecaf9f2f14ed67ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed67e8 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.739092:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e1a30b7e, rc 0) 00000100:00100000:2.0:1789264091.739121:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab423a1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:7419:x1876179322672128:12345-0@lo:101: Request processed in 74us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264091.739127:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789264091.739158:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322672128:0@lo:101: 00010000:00010000:2.0:1789264091.739174:0:7419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000645edddd/0xecaf9f2f14ed67e8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed67ef expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.739181:0:7419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000645edddd/0xecaf9f2f14ed67e8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed67ef expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264091.739196:0:7419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789264091.739205:0:7419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000645edddd/0xecaf9f2f14ed67e8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed67ef expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.739211:0:7419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000645edddd/0xecaf9f2f14ed67e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed67ef expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264091.739219:0:7419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c3aae2b1800 10000000:01000000:2.0:1789264091.739222:0:7419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789264091.739225:0:7419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c3aae2b1800 from 1 10000000:01000000:2.0:1789264091.739226:0:7419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789264091.739237:0:7419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 000000005495310e/0xecaf9f2f14ed67f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.739243:0:7419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 000000005495310e/0xecaf9f2f14ed67f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.739248:0:7419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 000000005495310e/0xecaf9f2f14ed67f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264091.739258:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322672256:0@lo:101: 00000100:00100000:2.0:1789264091.739282:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.739294:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074ee3c41 going to sleep for 11 seconds 00000100:00100000:2.0:1789264091.739313:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322672256 00000100:00100000:2.0:1789264091.739322:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322672256 00000100:00100000:2.0:1789264091.739354:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789264091.739359:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000eb719da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:7419:x1876179322672256:12345-0@lo:101: 00010000:00010000:2.0:1789264091.739366:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264091.739373:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003f9bdd79/0xecaf9f2f14ed67fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed67f6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.739385:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003f9bdd79/0xecaf9f2f14ed67fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed67f6 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.739391:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003f9bdd79/0xecaf9f2f14ed67fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed67f6 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.739397:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003f9bdd79, rc 0) 00000100:00100000:2.0:1789264091.739434:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000eb719da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:7419:x1876179322672256:12345-0@lo:101: Request processed in 74us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264091.739439:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789264091.739473:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322672256:0@lo:101: 00010000:00010000:2.0:1789264091.739482:0:7419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 000000005495310e/0xecaf9f2f14ed67f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.739489:0:7419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 000000005495310e/0xecaf9f2f14ed67f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264091.739500:0:7419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789264091.739507:0:7419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 000000005495310e/0xecaf9f2f14ed67f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.739559:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264091.739564:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xecaf9f2f14ed67e1 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.739572:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000148eba83 already unused, calling callback (00000000413e4e27) 10000000:00010000:3.0:1789264091.739574:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xecaf9f2f14ed67e1 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.739581:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xecaf9f2f14ed67e1 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789264091.739587:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xecaf9f2f14ed67e1 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264091.739593:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789264091.739615:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xecaf9f2f14ed67e1 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.739630:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789264091.739646:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xecaf9f2f14ed67e1 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.739652:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 00000000148eba83/0xecaf9f2f14ed67da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xecaf9f2f14ed67e1 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.739666:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264091.739667:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264091.739669:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264091.739926:0:7419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 000000005495310e/0xecaf9f2f14ed67f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264091.739940:0:7419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789264091.739943:0:7419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789264091.739948:0:7419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c3aae2b1800 10000000:01000000:2.0:1789264091.739950:0:7419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789264091.739953:0:7419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789264091.739955:0:7419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789264091.739981:0:7419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000359956ee/0xecaf9f2f14ed6804 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.739988:0:7419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000359956ee/0xecaf9f2f14ed6804 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.740006:0:7419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000359956ee/0xecaf9f2f14ed6804 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264091.740019:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322672512:0@lo:101: 00000100:00100000:2.0:1789264091.740049:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.740153:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074ee3c41 going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.740224:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322672512 00000100:00100000:3.0:1789264091.740229:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322672512 00000100:00100000:3.0:1789264091.740250:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789264091.740256:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dd6709a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:7419:x1876179322672512:12345-0@lo:101: 00010000:00010000:3.0:1789264091.740263:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264091.740271:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9f0beca/0xecaf9f2f14ed680b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6804 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.740284:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9f0beca/0xecaf9f2f14ed680b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6804 expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.740290:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9f0beca/0xecaf9f2f14ed680b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6804 expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.740297:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9f0beca, rc 0) 00000100:00100000:3.0:1789264091.740382:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dd6709a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:7419:x1876179322672512:12345-0@lo:101: Request processed in 126us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.740389:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789264091.740486:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322672512:0@lo:101: 00010000:00010000:2.0:1789264091.740502:0:7419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000359956ee/0xecaf9f2f14ed6804 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed680b expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.740509:0:7419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000359956ee/0xecaf9f2f14ed6804 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed680b expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264091.740591:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322672640:0@lo:501: 00000100:00100000:2.0:1789264091.740617:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.740648:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074ee3c41 going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.740698:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322672640 00000100:00100000:3.0:1789264091.740702:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322672640 00000100:00100000:3.0:1789264091.740717:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789264091.740722:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076642b6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:7419:x1876179322672640:12345-0@lo:501: 00000100:00100000:3.0:1789264091.740842:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076642b6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:7419:x1876179322672640:12345-0@lo:501: Request processed in 120us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.740849:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789264091.740917:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322672640:0@lo:501: 00000100:00100000:2.0:1789264091.740943:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322672768:0@lo:503: 00000100:00100000:2.0:1789264091.740979:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.741005:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074ee3c41 going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.741050:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322672768 00000100:00100000:3.0:1789264091.741054:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322672768 00000100:00100000:3.0:1789264091.741072:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789264091.741077:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003268a169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:7419:x1876179322672768:12345-0@lo:503: 00000100:00100000:3.0:1789264091.741219:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003268a169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:7419:x1876179322672768:12345-0@lo:503: Request processed in 142us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.741227:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789264091.741317:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322672768:0@lo:503: 00000100:00100000:0.0:1789264091.741682:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d47026b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322672384:0@lo:103: 00000100:00100000:0.0:1789264091.741714:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789264091.741857:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789264091.741923:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322672896:0@lo:502: 00000100:00100000:2.0:1789264091.741960:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.741980:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074ee3c41 going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.742092:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322672384 00000100:00100000:3.0:1789264091.742097:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322672384 00000100:00100000:3.0:1789264091.742134:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789264091.742140:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c06972f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:3622:x1876179322672384:12345-0@lo:103: 00010000:00010000:3.0:1789264091.742149:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264091.742164:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000058a569c7/0xecaf9f2f14ed67e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed67da expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.742177:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264091.742206:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c06972f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:3622:x1876179322672384:12345-0@lo:103: Request processed in 66us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.742212:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789264091.742284:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d47026b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322672384:0@lo:103: 00000100:00100000:0.0:1789264091.742309:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322672896 00000100:00100000:0.0:1789264091.742312:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322672896 00000100:00100000:0.0:1789264091.742476:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789264091.742483:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000128d0f1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:7419:x1876179322672896:12345-0@lo:502: 00000100:00100000:0.0:1789264091.742576:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000128d0f1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:7419:x1876179322672896:12345-0@lo:502: Request processed in 94us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264091.742583:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789264091.742712:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322672896:0@lo:502: 00000040:00080000:2.0:1789264091.742967:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789264091.743174:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1789264091.743196:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1789264091.743212:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1789264091.743225:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1789264091.743238:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1789264091.743251:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1789264091.743264:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1789264091.743277:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1789264091.743292:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1789264091.743305:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1789264091.743319:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1789264091.743392:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1789264091.743407:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1789264091.743428:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1789264091.743443:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1789264091.743456:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1789264091.743470:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1789264091.743498:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1789264091.743511:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1789264091.743526:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1789264091.743539:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1789264091.743553:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1789264091.743585:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322673024:0@lo:502: 00000100:00100000:2.0:1789264091.743635:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.743718:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074ee3c41 going to sleep for 11 seconds 00000100:00100000:1.0:1789264091.743814:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322673024 00000100:00100000:1.0:1789264091.743825:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322673024 00000100:00100000:1.0:1789264091.743897:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789264091.743905:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a65dc05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:7419:x1876179322673024:12345-0@lo:502: 00000100:00100000:1.0:1789264091.744007:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a65dc05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:7419:x1876179322673024:12345-0@lo:502: Request processed in 103us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264091.744015:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789264091.744088:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322673024:0@lo:502: 00000040:00080000:2.0:1789264091.744130:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1789264091.744138:0:7419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1789264091.744649:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264091.744661:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264091.744664:0:7432:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789264091.744668:0:7432:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789264091.744671:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789264091.744685:0:7432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000d4c0a501) 00000020:00000080:2.0:1789264091.744703:0:7432:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1789264091.744709:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789264091.744809:0:7432:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789264091.744815:0:7432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xecaf9f2f14ed6819 00000020:00000080:2.0:1789264091.745017:0:7432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789264091.745022:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264091.745025:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264091.745027:0:7432:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789264091.745029:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264091.745032:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264091.745034:0:7432:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789264091.745036:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789264091.745043:0:7432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000050b21a82) 00000020:00000080:2.0:1789264091.745053:0:7432:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1789264091.745065:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789264091.745066:0:7432:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789264091.745069:0:7432:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789264091.745075:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789264091.745130:0:7432:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b33807e7 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789264091.745150:0:7432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000022fdbe51) 00000020:00000080:2.0:1789264091.745160:0:7432:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1789264091.745219:0:7432:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789264091.745226:0:7432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xecaf9f2f14ed682e 00000020:00000080:2.0:1789264091.745320:0:7432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789264091.745509:0:7432:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789264091.745515:0:7432:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xecaf9f2f14ed6835 00080000:01000000:2.0:1789264091.745522:0:7432:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789264091.745525:0:7432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xecaf9f2f14ed683c 00080000:10000000:2.0:1789264091.745907:0:7432:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789264091.751364:0:7432:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1789264091.786045:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264091.835050:0:7432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1789264091.836438:0:7432:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1789264091.841858:0:7432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789264091.842196:0:7432:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789264091.850621:0:7432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789264091.850633:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264091.850644:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264091.850647:0:7432:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789264091.850650:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264091.850655:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264091.850657:0:7432:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789264091.850659:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789264091.850664:0:7432:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:00000080:3.0:1789264091.850687:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789264091.850698:0:7432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000034de666c) 00000020:00000080:3.0:1789264091.850717:0:7432:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789264091.850722:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789264091.850829:0:7432:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789264091.850837:0:7432:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789264091.850843:0:7432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xecaf9f2f14ed684a 00010000:00080000:3.0:1789264091.850870:0:7432:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004d647f35@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:3.0:1789264091.853126:0:7432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1789264091.854069:0:7432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789264091.854081:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789264091.854137:0:7432:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789264091.854156:0:7432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xecaf9f2f14ed6851 00000100:00080000:0.0:1789264091.854166:0:7432:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789264091.854171:0:7432:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000004d647f35 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264091.854202:0:7432:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000216c0438 x1876179322673152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789264091.854227:0:7432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789264091.854283:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003741e976 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322673280:0@lo:400: 00000100:00100000:0.0:1789264091.854342:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264091.854411:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322673280 00000100:00100000:0.0:1789264091.854417:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322673280 00000100:00100000:0.0:1789264091.854466:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789264091.854474:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2e43005 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322673280:12345-0@lo:400: 00000100:00100000:0.0:1789264091.854530:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2e43005 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322673280:12345-0@lo:400: Request processed in 56us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264091.854538:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789264091.854572:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003741e976 x1876179322673280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264091.854584:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003741e976 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322673280:0@lo:400: 00000020:01000000:0.0:1789264091.854639:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264091.854643:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264091.854644:0:7432:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789264091.854647:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789264091.854649:0:7432:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789264091.854651:0:7432:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789264091.854653:0:7432:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789264091.854654:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789264091.854656:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264091.854661:0:7432:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789264091.854664:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789264091.854668:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264091.854669:0:7432:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789264091.854672:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789264091.854702:0:7432:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789264091.854717:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264091.854719:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264091.854721:0:7432:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789264091.854723:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789264091.854725:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264091.854726:0:7432:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789264091.854729:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789264091.854730:0:7432:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789264091.854778:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264091.854782:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264091.854783:0:7432:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789264091.854786:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1789264091.854839:0:7419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1789264091.854865:0:7419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789264091.854878:0:7419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000359956ee/0xecaf9f2f14ed6804 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed680b expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.854887:0:7419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000359956ee/0xecaf9f2f14ed6804 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed680b expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264091.854896:0:7419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c3aae2b1800 from 1 10000000:01000000:0.0:1789264091.854898:0:7419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789264091.854918:0:7419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.854925:0:7419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.854940:0:7419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264091.854953:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003741e976 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322673408:0@lo:101: 00000100:00100000:0.0:1789264091.854981:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264091.855000:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000006c82aab going to sleep for 11 seconds 00000100:00100000:1.0:1789264091.855294:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000216c0438 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322673152:0@lo:38: 00000100:00100000:1.0:1789264091.855352:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264091.855391:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322673408 00000100:00100000:1.0:1789264091.855395:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322673408 00000100:00100000:1.0:1789264091.855434:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789264091.855440:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d445c93d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:7419:x1876179322673408:12345-0@lo:101: 00010000:00010000:1.0:1789264091.855448:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264091.855458:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed685f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6858 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.855476:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed685f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6858 expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.855485:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed685f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6858 expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.855493:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b974b8fb, rc 0) 00000100:00100000:1.0:1789264091.855520:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d445c93d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:7419:x1876179322673408:12345-0@lo:101: Request processed in 81us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264091.855532:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789264091.855574:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003741e976 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322673408:0@lo:101: 00010000:00010000:1.0:1789264091.855584:0:7419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed685f expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.855591:0:7419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed685f expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264091.856139:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000add96240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322673536:0@lo:256: 00000100:00100000:1.0:1789264091.856174:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264091.856199:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055122f22 going to sleep for 11 seconds 00000100:00100000:0.0:1789264091.856246:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322673536 00000100:00100000:0.0:1789264091.856250:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322673536 00000100:00100000:0.0:1789264091.856278:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789264091.856284:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000263e0aa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:7419:x1876179322673536:12345-0@lo:256: 20000000:01000000:0.0:1789264091.856299:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789264091.856317:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789264091.856320:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789264091.856402:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000263e0aa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:7419:x1876179322673536:12345-0@lo:256: Request processed in 118us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264091.856410:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789264091.856838:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322673152 00000100:00100000:3.0:1789264091.856843:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322673152 00000100:00100000:3.0:1789264091.856878:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789264091.856882:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084941411 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1876179322673152:12345-0@lo:38: 00010000:00080000:3.0:1789264091.856900:0:6495:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:3.0:1789264091.856931:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xecaf9f2f14ed6866 00000004:00100000:3.0:1789264091.856944:0:6495:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789264091.856949:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789264091.857076:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000add96240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322673536:0@lo:256: 10000000:01000000:1.0:1789264091.857645:0:7419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789264091.857849:0:7419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed685f expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.857859:0:7419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed685f expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264091.857867:0:7419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3aae2b1800 from 1 10000000:01000000:1.0:1789264091.857870:0:7419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789264091.857893:0:7419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.857899:0:7419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.857906:0:7419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264091.857928:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000add96240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322673664:0@lo:101: 00000100:00100000:1.0:1789264091.857968:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264091.858035:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055122f22 going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.858082:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322673664 00000100:00100000:3.0:1789264091.858088:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322673664 00000100:00100000:3.0:1789264091.858123:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789264091.858131:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ad647ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:7419:x1876179322673664:12345-0@lo:101: 00010000:00010000:3.0:1789264091.858141:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264091.858159:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f77cf2a0/0xecaf9f2f14ed6874 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed686d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.858179:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f77cf2a0/0xecaf9f2f14ed6874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed686d expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.858189:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f77cf2a0/0xecaf9f2f14ed6874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed686d expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.858198:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f77cf2a0, rc 0) 00000100:00100000:3.0:1789264091.858253:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ad647ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:7419:x1876179322673664:12345-0@lo:101: Request processed in 124us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.858260:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789264091.858345:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000add96240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322673664:0@lo:101: 00010000:00010000:2.0:1789264091.858357:0:7419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6874 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.858365:0:7419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6874 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264091.858466:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322673792:0@lo:501: 00000100:00100000:2.0:1789264091.858492:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.858513:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df8e17b6 going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.858583:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322673792 00000100:00100000:3.0:1789264091.858587:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322673792 00000100:00100000:3.0:1789264091.858615:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789264091.858621:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bedb55e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:7419:x1876179322673792:12345-0@lo:501: 00000100:00100000:3.0:1789264091.858711:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bedb55e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:7419:x1876179322673792:12345-0@lo:501: Request processed in 91us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.858718:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789264091.858824:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322673792:0@lo:501: 00000100:00100000:2.0:1789264091.858854:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322673920:0@lo:503: 00000100:00100000:2.0:1789264091.858891:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.858922:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df8e17b6 going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.858963:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322673920 00000100:00100000:3.0:1789264091.858967:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322673920 00000100:00100000:3.0:1789264091.858993:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789264091.858999:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b80055f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:7419:x1876179322673920:12345-0@lo:503: 00000040:00080000:3.0:1789264091.859032:0:6482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789264091.859069:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b80055f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:7419:x1876179322673920:12345-0@lo:503: Request processed in 71us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.859075:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789264091.859437:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5a56763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322673920:0@lo:503: 00000040:00080000:0.0:1789264091.860028:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789264091.860077:0:7419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1789264091.860216:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789264091.861139:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1789264091.861210:0:7419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789264091.861234:0:7419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789264091.861249:0:7419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6874 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.861260:0:7419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6874 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264091.861311:0:7419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789264091.861313:0:7419:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c3aae2b1800 10000000:01000000:0.0:1789264091.861316:0:7419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c3aae2b1800 10000000:01000000:0.0:1789264091.861318:0:7419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789264091.861321:0:7419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3aae2b1800 from 1 10000000:01000000:0.0:1789264091.861323:0:7419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789264091.861345:0:7419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000c3e84245/0xecaf9f2f14ed687b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.861350:0:7419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000c3e84245/0xecaf9f2f14ed687b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.861356:0:7419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000c3e84245/0xecaf9f2f14ed687b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264091.861367:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e425e6d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322674048:0@lo:101: 00000100:00100000:0.0:1789264091.861407:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264091.861446:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322674048 00000100:00100000:0.0:1789264091.861448:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098a751b8 going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.861452:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322674048 00000100:00100000:3.0:1789264091.861487:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789264091.861495:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b0440ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:7419:x1876179322674048:12345-0@lo:101: 00010000:00010000:3.0:1789264091.861505:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264091.861515:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005be6229b/0xecaf9f2f14ed6882 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed687b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.861534:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005be6229b/0xecaf9f2f14ed6882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed687b expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.861543:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005be6229b/0xecaf9f2f14ed6882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed687b expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264091.861548:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005be6229b, rc 0) 00000100:00100000:3.0:1789264091.861579:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b0440ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:7419:x1876179322674048:12345-0@lo:101: Request processed in 86us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.861585:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789264091.861602:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e425e6d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322674048:0@lo:101: 00010000:00010000:0.0:1789264091.861613:0:7419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000c3e84245/0xecaf9f2f14ed687b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6882 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264091.861621:0:7419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000c3e84245/0xecaf9f2f14ed687b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6882 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264091.861683:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e425e6d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322674176:0@lo:501: 00000100:00100000:0.0:1789264091.861707:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264091.861735:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098a751b8 going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.861799:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322674176 00000100:00100000:3.0:1789264091.861803:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322674176 00000100:00100000:3.0:1789264091.861832:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789264091.861838:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0f3a3e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:7419:x1876179322674176:12345-0@lo:501: 00000100:00100000:3.0:1789264091.861919:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0f3a3e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:7419:x1876179322674176:12345-0@lo:501: Request processed in 82us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.861926:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789264091.862009:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e425e6d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322674176:0@lo:501: 00000100:00100000:0.0:1789264091.862027:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e425e6d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322674304:0@lo:503: 00000100:00100000:0.0:1789264091.862053:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264091.862075:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098a751b8 going to sleep for 11 seconds 00000100:00080000:0.0:1789264091.862304:0:6495:0:(import.c:65:import_set_state_nolock()) 0000000039b87a77 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789264091.862351:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084941411 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3621:x1876179322673152:12345-0@lo:38: Request processed in 5467us (6999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264091.862362:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789264091.862386:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322674304 00000100:00100000:3.0:1789264091.862391:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322674304 00000100:00100000:3.0:1789264091.862429:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789264091.862435:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c35f246a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:7419:x1876179322674304:12345-0@lo:503: 00000100:00100000:1.0:1789264091.862440:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789264091.862447:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789264091.862455:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789264091.862460:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789264091.862462:0:3621:0:(import.c:65:import_set_state_nolock()) 000000004d647f35 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789264091.862477:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000216c0438 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322673152:0@lo:38: 00000100:00100000:3.0:1789264091.862515:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c35f246a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:7419:x1876179322674304:12345-0@lo:503: Request processed in 80us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.862522:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789264091.862574:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae47bfe2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322674432:0@lo:41: 00000100:00100000:1.0:1789264091.862605:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264091.862642:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322674432 00000100:00100000:1.0:1789264091.862646:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322674432 00000100:00100000:1.0:1789264091.862677:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789264091.862684:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e5d1121 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1876179322674432:12345-0@lo:41: 00000004:00000024:1.0:1789264091.862703:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1789264091.862770:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e5d1121 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1876179322674432:12345-0@lo:41: Request processed in 85us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264091.862777:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789264091.862807:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e425e6d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322674304:0@lo:503: 00000100:00100000:3.0:1789264091.862860:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae47bfe2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322674432:0@lo:41: 00000040:00080000:2.0:1789264091.863038:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789264091.863104:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015537b77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322674560:0@lo:502: 00000100:00100000:2.0:1789264091.863142:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.863175:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc596d38 going to sleep for 11 seconds 00000100:00100000:1.0:1789264091.863183:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322674560 00000100:00100000:1.0:1789264091.863189:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322674560 00000100:00100000:1.0:1789264091.863218:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789264091.863224:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fae504a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:7419:x1876179322674560:12345-0@lo:502: 00000100:00100000:1.0:1789264091.863357:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fae504a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:7419:x1876179322674560:12345-0@lo:502: Request processed in 133us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264091.863372:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789264091.863441:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015537b77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322674560:0@lo:502: 00000040:00080000:2.0:1789264091.863572:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789264091.863596:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789264091.863611:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789264091.863622:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789264091.863634:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789264091.863660:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789264091.863671:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789264091.863677:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789264091.863684:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789264091.863690:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789264091.863696:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789264091.863703:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789264091.863709:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789264091.863715:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789264091.863722:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789264091.863728:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789264091.863734:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789264091.863809:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789264091.863829:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789264091.863843:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789264091.863856:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789264091.863881:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789264091.863895:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789264091.863908:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789264091.863928:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789264091.863935:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789264091.863941:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789264091.863947:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1789264091.863963:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015537b77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322674688:0@lo:502: 00000100:00100000:2.0:1789264091.863987:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.864018:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc596d38 going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.864025:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322674688 00000100:00100000:3.0:1789264091.864029:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322674688 00000100:00100000:3.0:1789264091.864057:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789264091.864063:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a385052 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:7419:x1876179322674688:12345-0@lo:502: 00000100:00100000:3.0:1789264091.864150:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a385052 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:7419:x1876179322674688:12345-0@lo:502: Request processed in 87us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.864156:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789264091.864198:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015537b77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322674688:0@lo:502: 00000040:00080000:2.0:1789264091.864231:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789264091.864237:0:7419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789264091.864594:0:7438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789264091.864605:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000007fb3e650) 00000020:00000080:2.0:1789264091.864617:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789264091.864674:0:7438:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b33807e7 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789264091.864676:0:7438:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b33807e7 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789264091.864678:0:7438:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b33807e7 3 00010000:00080000:2.0:1789264091.864697:0:7438:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003033f398@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:2.0:1789264091.866307:0:7438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1789264091.866482:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789264091.866514:0:7438:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789264091.866524:0:7438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xecaf9f2f14ed6890 00000100:00080000:2.0:1789264091.866531:0:7438:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789264091.866536:0:7438:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000003033f398 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1789264091.866563:0:7438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000015537b77 x1876179322674816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789264091.866587:0:7438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789264091.866684:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015537b77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876179322674816:0@lo:38: 00000100:00100000:1.0:1789264091.866735:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.866807:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322674816 00000100:00100000:2.0:1789264091.866813:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322674816 00000100:00100000:2.0:1789264091.866872:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789264091.866884:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdca23d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1876179322674816:12345-0@lo:38: 00010000:00080000:2.0:1789264091.866902:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:2.0:1789264091.866928:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xecaf9f2f14ed6897 00000004:00100000:2.0:1789264091.866941:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789264091.866963:0:6492:0:(import.c:65:import_set_state_nolock()) 00000000861651d6 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789264091.867012:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdca23d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876179322674816:12345-0@lo:38: Request processed in 127us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264091.867020:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789264091.867043:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000015537b77 x1876179322674816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789264101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264091.867053:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789264091.867059:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789264091.867065:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789264091.867069:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789264091.867071:0:3621:0:(import.c:65:import_set_state_nolock()) 000000003033f398 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789264091.867075:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015537b77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876179322674816:0@lo:38: 00000040:00080000:2.0:1789264091.867118:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:0.0:1789264091.867241:0:7439:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:1.0:1789264091.867451:0:7419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789264091.867477:0:7419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789264091.867527:0:7419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000c3e84245/0xecaf9f2f14ed687b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6882 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.867536:0:7419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000c3e84245/0xecaf9f2f14ed687b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6882 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789264091.867578:0:7419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789264091.867579:0:7419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789264091.867581:0:7419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789264091.867581:0:7419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789264091.867583:0:7419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789264091.867584:0:7419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789264091.867585:0:7419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789264091.867586:0:7419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789264091.867587:0:7419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789264091.867588:0:7419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789264091.867593:0:7419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789264091.867596:0:7419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1789264091.867599:0:7419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789264091.867600:0:7419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789264091.867601:0:7419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789264091.867601:0:7419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789264091.867602:0:7419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789264091.867603:0:7419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789264091.867604:0:7419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789264091.867605:0:7419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789264091.867606:0:7419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789264091.867606:0:7419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789264091.867607:0:7419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789264091.867620:0:7419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789264091.867630:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e7d24e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322674944:0@lo:253: 00000100:00100000:1.0:1789264091.867664:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264091.867691:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000564447ab going to sleep for 11 seconds 00000100:00100000:0.0:1789264091.867770:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322674944 00000100:00100000:0.0:1789264091.867774:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322674944 00000100:00100000:0.0:1789264091.867804:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789264091.867810:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006bd6d6ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:7419:x1876179322674944:12345-0@lo:253: 20000000:01000000:0.0:1789264091.867827:0:6484:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789264091.867838:0:6484:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789264091.869396:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789264091.869462:0:6484:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789264091.869477:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789264091.869904:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789264091.869910:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789264091.869928:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.869950:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fe411be0/0xecaf9f2f14ed67be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed67b7 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.869958:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed685f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6858 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.869963:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.869996:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed685f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6858 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264091.870125:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006bd6d6ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:7419:x1876179322674944:12345-0@lo:253: Request processed in 2312us (2458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264091.870135:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789264091.870209:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e7d24e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:7419:1876179322674944:0@lo:253: 10000000:01000000:3.0:1789264091.870222:0:7419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789264091.870225:0:7419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789264091.870227:0:7419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789264091.870228:0:7419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789264091.870229:0:7419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789264091.870230:0:7419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789264091.870232:0:7419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789264091.870234:0:7419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789264091.870235:0:7419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789264091.870236:0:7419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789264091.870238:0:7419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789264091.870239:0:7419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789264091.870253:0:7419:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789264091.870285:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed685f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6858 expref: 14 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264091.870299:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062e9b035 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876179322675072:0@lo:104: 00000100:00100000:2.0:1789264091.870343:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789264091.870440:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fe411be0/0xecaf9f2f14ed67be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed67b7 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.870449:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fe411be0/0xecaf9f2f14ed67be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed67b7 expref: 14 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264091.870458:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000464ebd64 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876179322675200:0@lo:104: 00000100:00100000:2.0:1789264091.870485:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264091.871099:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322675072 00000100:00100000:0.0:1789264091.871106:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322675072 00000100:00100000:2.0:1789264091.871119:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f9179224 going to sleep for 11 seconds 00000100:00100000:0.0:1789264091.871138:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322675200 00000100:00100000:0.0:1789264091.871142:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322675200 00000100:00100000:2.0:1789264091.871152:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789264091.871163:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000490ff84c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:6506:x1876179322675072:12345-0@lo:104: 00010000:00010000:2.0:1789264091.871174:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed685f expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.871226:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789264091.871231:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000490ff84c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:6506:x1876179322675072:12345-0@lo:104: Request processed in 73us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264091.872100:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789264091.872125:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789264091.872133:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001c32a10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:6506:x1876179322675200:12345-0@lo:104: 00010000:00010000:2.0:1789264091.872142:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed67be expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.872193:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789264091.872198:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001c32a10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:6506:x1876179322675200:12345-0@lo:104: Request processed in 68us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264091.872204:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789264091.872230:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789264091.872234:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264091.872236:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed685f expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.872240:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed67be expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.872252:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b8932a83 already unused, calling callback (00000000413e4e27) 10000000:00010000:2.0:1789264091.872256:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed685f expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.872270:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003f909c2b already unused, calling callback (00000000413e4e27) 00010000:00010000:2.0:1789264091.872272:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed685f expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264091.872275:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed67be expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264091.872288:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed685f expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.872291:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed67be expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264091.872301:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed67be expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264091.872306:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789264091.872340:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed67be expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.872355:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264091.872374:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed67be expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.872380:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 000000003f909c2b/0xecaf9f2f14ed67b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed67be expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.872394:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264091.872396:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264091.872399:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264091.872412:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001344ed8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322675328:0@lo:103: 00000100:00100000:1.0:1789264091.872460:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264091.872502:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322675328 00000100:00100000:1.0:1789264091.872506:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322675328 00010000:00010000:1.0:1789264091.872527:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fe411be0/0xecaf9f2f14ed67be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed67b7 expref: 15 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264091.872549:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789264091.872556:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000151e552b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:3625:x1876179322675328:12345-0@lo:103: 00010000:00010000:1.0:1789264091.872565:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264091.872570:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fe411be0/0xecaf9f2f14ed67be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed67b7 expref: 15 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.872580:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fe411be0/0xecaf9f2f14ed67be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed67b7 expref: 15 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.872597:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264091.872627:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000151e552b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:3625:x1876179322675328:12345-0@lo:103: Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264091.872654:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789264091.872688:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001344ed8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322675328:0@lo:103: 10000000:01000000:2.0:1789264091.872791:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789264091.872813:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed685f expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.872820:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789264091.872837:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed685f expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.872843:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 00000000b8932a83/0xecaf9f2f14ed6858 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed685f expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264091.872856:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264091.872858:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264091.872859:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264091.872866:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789264091.872875:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025f9b9c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322675456:0@lo:103: 00000100:00100000:2.0:1789264091.872904:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.873028:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062e9b035 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876179322675072:0@lo:104: 00010000:00010000:2.0:1789264091.873039:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fe411be0/0xecaf9f2f14ed67be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed67b7 expref: 14 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264091.873050:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000464ebd64 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876179322675200:0@lo:104: 00010000:00010000:2.0:1789264091.873064:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264091.873341:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322675456 00000100:00100000:1.0:1789264091.873346:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322675456 00010000:00010000:1.0:1789264091.873361:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed685f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6858 expref: 14 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264091.873390:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789264091.873397:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000797832d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:3623:x1876179322675456:12345-0@lo:103: 00010000:00010000:1.0:1789264091.873404:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264091.873407:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed685f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6858 expref: 14 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.873416:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed685f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6858 expref: 14 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.873437:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b974b8fb/0xecaf9f2f14ed685f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6858 expref: 14 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.873448:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.873455:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789264091.873470:0:6476:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003560844s 00010000:00010000:1.0:1789264091.873474:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.873479:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.873492:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.873498:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.873503:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c7e1c135 already unused, calling callback (00000000fe6a1ae7) 00010000:00010000:1.0:1789264091.873506:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.873513:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.873529:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.873538:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264091.873572:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000797832d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:3623:x1876179322675456:12345-0@lo:103: Request processed in 176us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264091.873578:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789264091.873627:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025f9b9c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322675456:0@lo:103: 00010000:00010000:1.0:1789264091.873661:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.873668:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264091.873673:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c7e1c135/0xecaf9f2f14ed689e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789264091.874293:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1789264091.874478:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789264091.874673:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789264091.874912:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789264091.875172:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789264091.875331:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1789264091.876125:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789264091.876346:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789264091.876528:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1789264091.876675:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1789264091.877101:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1789264091.877266:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1789264091.878410:0:7419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1789264091.878649:0:7444:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1789264091.878692:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000464ebd64 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7444:1876179322675584:0@lo:700: 00000100:00100000:2.0:1789264091.878780:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.878808:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f4a1439d going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.878893:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322675584 00000100:00100000:3.0:1789264091.878900:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322675584 00000100:00100000:3.0:1789264091.878942:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789264091.878950:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062e9b035 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7444:x1876179322675584:12345-0@lo:700: 00000040:01000000:1.0:1789264091.879291:0:7419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789264091.879645:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021fe74f1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876179322675712:0@lo:1000: 00000100:00100000:2.0:1789264091.879681:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.879713:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000194e6807 going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.879773:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322675712 00000100:00100000:3.0:1789264091.879777:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322675712 00000100:00100000:3.0:1789264091.879823:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789264091.879829:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd3eacd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1876179322675712:12345-0@lo:1000: 00000100:00100000:3.0:1789264091.879891:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd3eacd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1876179322675712:12345-0@lo:1000: Request processed in 62us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.879898:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789264091.879992:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021fe74f1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876179322675712:0@lo:1000: 00000040:01000000:2.0:1789264091.880026:0:7445:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1789264091.880048:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021fe74f1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876179322675840:0@lo:700: 00000100:00100000:2.0:1789264091.880073:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.880085:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a85acc3c going to sleep for 11 seconds 00000040:01000000:1.0:1789264091.880499:0:7419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789264091.880597:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789264091.881211:0:7419:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789264091.881219:0:7419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789264091.881338:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1789264091.882161:0:7443:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789264091.882166:0:7443:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789264091.882179:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322675840 00000100:00100000:3.0:1789264091.882187:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322675840 00000100:00100000:3.0:1789264091.882236:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789264091.882243:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e1cb644 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7445:x1876179322675840:12345-0@lo:700: 00000100:00100000:3.0:1789264091.882333:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e1cb644 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7445:x1876179322675840:12345-0@lo:700: Request processed in 89us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.882342:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789264091.882356:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021fe74f1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876179322675840:0@lo:700: 00000100:00100000:0.0:1789264091.882415:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7e51b0a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7445:1876179322675968:0@lo:900: 00000100:00100000:0.0:1789264091.882474:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264091.882498:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098a751b8 going to sleep for 11 seconds 00000100:00100000:2.0:1789264091.882709:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322675968 00000100:00100000:2.0:1789264091.882714:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322675968 00000100:00100000:2.0:1789264091.882780:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789264091.882787:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062468ce2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7445:x1876179322675968:12345-0@lo:900: 00000100:00100000:2.0:1789264091.882831:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062468ce2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7445:x1876179322675968:12345-0@lo:900: Request processed in 46us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264091.882838:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789264091.883341:0:7445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d7e51b0a x1876179322675968/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789264107 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264091.883354:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7e51b0a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7445:1876179322675968:0@lo:900: 00000100:00100000:0.0:1789264091.883452:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7e51b0a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876179322676096:0@lo:1000: 00000100:00100000:0.0:1789264091.883488:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264091.883565:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5cc2b2a going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.883603:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322676096 00000100:00100000:3.0:1789264091.883608:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322676096 00000100:00100000:3.0:1789264091.883653:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789264091.883660:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001338c963 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1876179322676096:12345-0@lo:1000: 00000100:00100000:3.0:1789264091.883782:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001338c963 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1876179322676096:12345-0@lo:1000: Request processed in 122us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.883789:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 40000000:02000000:3.0:1789264091.883889:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:0.0:1789264091.883898:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7e51b0a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876179322676096:0@lo:1000: 00000004:00080000:0.0:1789264091.883980:0:7445:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000098a751b8 with version 0 00000020:00100000:0.0:1789264091.883995:0:7445:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789264091.884001:0:7445:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d7e51b0a x1876179322676352/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789264091.884013:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7e51b0a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876179322676352:0@lo:1000: 00000100:00100000:0.0:1789264091.884035:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264091.884101:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090a9f9a0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264091.884135:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322676352 00000100:00100000:2.0:1789264091.884140:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322676352 00000100:00100000:2.0:1789264091.884197:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789264091.884204:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5e263 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1876179322676352:12345-0@lo:1000: 00000040:00080000:1.0:1789264091.885504:0:7419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789264091.886140:0:7419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789264091.886170:0:7419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789264091.886339:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789264091.888682:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1789264091.889327:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789264091.889479:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789264091.889604:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789264091.889802:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789264091.889949:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789264091.890128:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789264091.890252:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789264091.890402:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789264091.890584:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789264091.890712:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00000100:00100000:3.0:1789264091.892004:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062e9b035 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7444:x1876179322675584:12345-0@lo:700: Request processed in 13049us (13219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.892017:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789264091.892292:0:7444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000464ebd64 x1876179322675584/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789264107 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264091.892307:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000464ebd64 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7444:1876179322675584:0@lo:700: 40000000:02000000:0.0:1789264091.892323:0:7444:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:1.0:1789264091.893372:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789264091.893557:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789264091.893700:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789264091.893858:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789264091.893987:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789264091.894160:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789264091.894459:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789264091.894605:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789264091.894725:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789264091.894885:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789264091.895015:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789264091.895152:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789264091.895276:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789264091.895447:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789264091.895578:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789264091.895713:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789264091.895860:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789264091.896033:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789264091.896159:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789264091.896296:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789264091.896440:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789264091.896582:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789264091.896796:0:7419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1789264091.899493:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1789264091.899663:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5e263 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1876179322676352:12345-0@lo:1000: Request processed in 15455us (15623us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789264091.899683:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1789264091.899791:0:7445:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789264091.899797:0:7445:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789264091.899811:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7e51b0a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876179322676352:0@lo:1000: 00000100:00100000:2.0:1789264091.899899:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a7c46fc pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876179322676480:0@lo:1000: 00000100:00100000:2.0:1789264091.899935:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264091.899979:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000078779267 going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.899984:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322676480 00000100:00100000:3.0:1789264091.899993:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322676480 00000100:00100000:3.0:1789264091.900067:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789264091.900075:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cc31327 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1876179322676480:12345-0@lo:1000: 00000100:00100000:3.0:1789264091.900144:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cc31327 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1876179322676480:12345-0@lo:1000: Request processed in 71us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264091.900152:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789264091.900358:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a7c46fc pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876179322676480:0@lo:1000: 00000040:00080000:2.0:1789264091.900384:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789264091.900414:0:7445:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000009c5f0c28 with version 1 00000004:00080000:3.0:1789264091.900505:0:7435:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000ed2562e8 version 1 rpc_version 1 00000020:00100000:3.0:1789264091.900525:0:7435:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789264091.900532:0:7435:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a0862724 x1876179322676736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789264091.900548:0:7435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0862724 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7435:1876179322676736:0@lo:1000: 00000100:00100000:3.0:1789264091.900579:0:7435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1789264091.900588:0:7419:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000100:00100000:3.0:1789264091.900597:0:7435:0:(client.c:2715:ptlrpc_set_wait()) set 000000007cbd823f going to sleep for 11 seconds 00000100:00100000:3.0:1789264091.900615:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322676736 00000100:00100000:3.0:1789264091.900619:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322676736 00000004:00000080:1.0:1789264091.900619:0:7419:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb65101cff988 00100000:10000000:1.0:1789264091.900627:0:7419:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:3.0:1789264091.900652:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789264091.900659:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2641030 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7435:x1876179322676736:12345-0@lo:1000: 00000020:01000004:1.0:1789264091.902075:0:7419:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789264091.902106:0:7419:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789264091.902126:0:7419:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789264091.902142:0:7419:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:2.0:1789264091.902789:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789264091.902845:0:7445:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000020:00000004:2.0:1789264091.904554:0:7419:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789264091.904806:0:7419:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:0.0:1789264091.912388:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1789264091.912620:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2641030 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7435:x1876179322676736:12345-0@lo:1000: Request processed in 11949us (12029us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789264091.912633:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1789264091.912817:0:7435:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789264091.912823:0:7435:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789264091.912842:0:7435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0862724 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7435:1876179322676736:0@lo:1000: 00000040:00080000:1.0:1789264091.918137:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789264091.923640:0:7444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789264091.923722:0:7444:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789264091.923727:0:7444:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1789264092.812800:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264093.833945:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789264094.164649:0:7689:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1789264094.644476:0:7741:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789264094.644644:0:7741:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789264094.857965:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264095.881970:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789264096.545961:0:7843:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789264096.546210:0:7843:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789264096.906594:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789264097.085343:0:7891:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa3819e90 20000000:00000080:2.0:1789264097.085358:0:7891:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c3aba96d800 uarg=0000000000000000 20000000:01000000:2.0:1789264097.085404:0:7891:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789264097.085409:0:7891:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789264097.085414:0:7891:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789264097.085475:0:7891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789264097.085485:0:7891:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789264097.087929:0:7891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789264097.088136:0:7891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789264097.088161:0:7891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789264097.088175:0:7891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789264097.088189:0:7891:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789264097.088206:0:7891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264097.088222:0:7891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000059535474/0xecaf9f2f14ed6786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed677f expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264097.088227:0:7891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f77cf2a0/0xecaf9f2f14ed6874 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed686d expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264097.088232:0:7891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264097.088262:0:7891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f77cf2a0/0xecaf9f2f14ed6874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed686d expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264097.088273:0:7891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f77cf2a0/0xecaf9f2f14ed6874 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed686d expref: 12 pid: 6485 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264097.088287:0:7891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a7c46fc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7891:1876179322676864:0@lo:104: 00000100:00100000:2.0:1789264097.088342:0:7891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264097.088426:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789264097.088438:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322676864 00000100:00100000:0.0:1789264097.088445:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322676864 00010000:00010000:2.0:1789264097.088480:0:7891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000059535474/0xecaf9f2f14ed6786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed677f expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264097.088487:0:7891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000059535474/0xecaf9f2f14ed6786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed677f expref: 12 pid: 6484 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264097.088489:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789264097.088495:0:7891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5bf0f27 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7891:1876179322676992:0@lo:104: 00000100:00100000:0.0:1789264097.088496:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db1e0497 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:7891:x1876179322676864:12345-0@lo:104: 00010000:00010000:0.0:1789264097.088506:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6874 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264097.088523:0:7891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264097.088534:0:7891:0:(client.c:2715:ptlrpc_set_wait()) set 0000000059ef7fe0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264097.088552:0:7891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a7c46fc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7891:1876179322676864:0@lo:104: 00010000:00010000:0.0:1789264097.088556:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789264097.088560:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db1e0497 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:7891:x1876179322676864:12345-0@lo:104: Request processed in 65us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264097.088566:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789264097.088600:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789264097.088600:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322676992 00000100:00100000:0.0:1789264097.088604:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322676992 00010000:00010000:3.0:1789264097.088605:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6874 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264097.088616:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264097.088620:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000464ebd64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:7891:x1876179322676992:12345-0@lo:104: 00010000:00010000:3.0:1789264097.088622:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002e58312b already unused, calling callback (00000000413e4e27) 10000000:00010000:3.0:1789264097.088625:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6874 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.088627:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6786 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264097.088632:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6874 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789264097.088639:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6874 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264097.088644:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789264097.088669:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789264097.088673:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000464ebd64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:7891:x1876179322676992:12345-0@lo:104: Request processed in 53us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264097.088679:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789264097.088680:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6874 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264097.088686:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264097.088692:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264097.088696:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6786 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264097.088701:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6874 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.088701:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b7c01cc4 already unused, calling callback (00000000413e4e27) 10000000:00010000:0.0:1789264097.088704:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6786 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264097.088707:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 000000002e58312b/0xecaf9f2f14ed686d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6874 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.088710:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6786 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264097.088715:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6786 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264097.088719:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789264097.088720:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264097.088721:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264097.088723:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264097.088731:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000713dacb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322677120:0@lo:103: 00010000:00010000:0.0:1789264097.088731:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6786 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.088736:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264097.088760:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6786 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.088766:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 00000000b7c01cc4/0xecaf9f2f14ed677f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6786 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264097.088781:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789264097.088788:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264097.088790:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264097.088791:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264097.088859:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322677120 00000100:00100000:3.0:1789264097.088863:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322677120 00000100:00100000:1.0:1789264097.088873:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023e6e879 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322677248:0@lo:103: 00010000:00010000:3.0:1789264097.088881:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f77cf2a0/0xecaf9f2f14ed6874 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed686d expref: 13 pid: 6485 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264097.088898:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264097.089108:0:7891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5bf0f27 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7891:1876179322676992:0@lo:104: 00010000:00010000:2.0:1789264097.089129:0:7891:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264097.089165:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322677248 00000100:00100000:3.0:1789264097.089170:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322677248 00000100:00100000:0.0:1789264097.089179:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789264097.089186:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000059535474/0xecaf9f2f14ed6786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed677f expref: 14 pid: 6484 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264097.089192:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b704d57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:3623:x1876179322677120:12345-0@lo:103: 00010000:00010000:0.0:1789264097.089207:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789264097.089209:0:6477:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1789264097.089215:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f77cf2a0/0xecaf9f2f14ed6874 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed686d expref: 14 pid: 6485 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264097.089218:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789264097.089230:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f77cf2a0/0xecaf9f2f14ed6874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed686d expref: 14 pid: 6485 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.089240:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f77cf2a0/0xecaf9f2f14ed6874 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed686d expref: 14 pid: 6485 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.089248:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264097.089283:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b704d57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:3623:x1876179322677120:12345-0@lo:103: Request processed in 96us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264097.089289:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789264097.089306:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264097.089313:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000601c8559 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:3624:x1876179322677248:12345-0@lo:103: 00010000:00010000:0.0:1789264097.089322:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264097.089326:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000059535474/0xecaf9f2f14ed6786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed677f expref: 12 pid: 6484 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.089333:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000059535474/0xecaf9f2f14ed6786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed677f expref: 12 pid: 6484 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.089356:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000059535474/0xecaf9f2f14ed6786 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed677f expref: 12 pid: 6484 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.089367:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.089375:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264097.089396:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000713dacb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322677120:0@lo:103: 00010000:00010000:0.0:1789264097.089397:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.089408:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.089413:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.089418:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.089423:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002dda3120 already unused, calling callback (00000000fe6a1ae7) 00010000:00010000:0.0:1789264097.089427:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.089433:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.089449:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264097.089469:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789264097.089480:0:7891:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264097.089488:0:7891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264097.089493:0:7891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002dda3120/0xecaf9f2f14ed68a5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264097.089504:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000601c8559 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:3624:x1876179322677248:12345-0@lo:103: Request processed in 190us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264097.089512:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789264097.089528:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023e6e879 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322677248:0@lo:103: 00000100:00100000:1.0:1789264097.289980:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002b817961 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322677376:0@lo:400: 00000100:00100000:0.0:1789264097.289991:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023e6e879 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322677632:0@lo:400: 00000100:00100000:1.0:1789264097.290097:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264097.290136:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264097.290137:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322677376 00000100:00100000:0.0:1789264097.290144:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322677376 00000100:00100000:3.0:1789264097.290194:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6e7502f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322677504:0@lo:400: 00000100:00100000:0.0:1789264097.290194:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322677632 00000100:00100000:0.0:1789264097.290200:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322677632 00000100:00100000:1.0:1789264097.290215:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001344ed8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322677760:0@lo:41: 00000100:00100000:2.0:1789264097.290216:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264097.290228:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789264097.290230:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000151e552b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322677376:12345-0@lo:400: 00000100:00100000:0.0:1789264097.290236:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789264097.290264:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789264097.290273:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789264097.290278:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5bf0f27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322677632:12345-0@lo:400: 00000100:00100000:2.0:1789264097.290732:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000151e552b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322677376:12345-0@lo:400: Request processed in 507us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264097.290740:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789264097.290871:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002b817961 x1876179322677376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264097.290883:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002b817961 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322677376:0@lo:400: 00000100:00100000:3.0:1789264097.293435:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264097.293478:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5bf0f27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322677632:12345-0@lo:400: Request processed in 3192us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264097.293494:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789264097.293497:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322677504 00000100:00100000:2.0:1789264097.293504:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322677504 00000100:00100000:1.0:1789264097.293556:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264097.293566:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322677760 00010000:00080000:0.0:1789264097.293579:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000023e6e879 x1876179322677632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264097.293580:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322677760 00000100:00100000:3.0:1789264097.293592:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264097.293593:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023e6e879 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322677632:0@lo:400: 00000100:00100000:3.0:1789264097.293617:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000713dacb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1876179322677504:12345-0@lo:400: 00000100:00100000:3.0:1789264097.293715:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000713dacb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1876179322677504:12345-0@lo:400: Request processed in 111us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264097.293723:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789264097.293781:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264097.293786:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6e7502f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322677504:0@lo:400: 00000100:00100000:3.0:1789264097.293792:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acbff896 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322677760:12345-0@lo:41: 00000004:00000024:3.0:1789264097.293827:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789264097.294214:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acbff896 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322677760:12345-0@lo:41: Request processed in 424us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264097.294223:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789264097.294376:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001344ed8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322677760:0@lo:41: 00010000:00010000:2.0:1789264097.930032:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264098.954997:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789264099.465810:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789264099.465818:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c3aae2b1800 from 4 10000000:01000000:2.0:1789264099.465823:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789264099.465861:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 0000000038bee26f/0xecaf9f2f14ed68ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264099.465872:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 0000000038bee26f/0xecaf9f2f14ed68ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264099.465881:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 0000000038bee26f/0xecaf9f2f14ed68ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264099.465901:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a7c46fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322677888:0@lo:101: 00000100:00100000:2.0:1789264099.465972:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264099.466019:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c5f0c28 going to sleep for 11 seconds 00000100:00100000:0.0:1789264099.467557:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322677888 00000100:00100000:0.0:1789264099.467570:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322677888 00000100:00100000:0.0:1789264099.467624:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789264099.467632:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000756baa98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:6487:x1876179322677888:12345-0@lo:101: 00010000:00010000:0.0:1789264099.467646:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264099.467666:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002438a479/0xecaf9f2f14ed68b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed68ac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264099.467690:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002438a479/0xecaf9f2f14ed68b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68ac expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264099.467700:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002438a479/0xecaf9f2f14ed68b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68ac expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264099.467709:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002438a479, rc 0) 00000100:00100000:0.0:1789264099.467786:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000756baa98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6487:x1876179322677888:12345-0@lo:101: Request processed in 155us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264099.467792:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789264099.467800:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a7c46fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322677888:0@lo:101: 00010000:00010000:3.0:1789264099.467815:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 0000000038bee26f/0xecaf9f2f14ed68ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68b3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.467823:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 0000000038bee26f/0xecaf9f2f14ed68ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed68b3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264099.467880:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c55ae5d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322678016:0@lo:256: 00000100:00100000:3.0:1789264099.467916:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.467949:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 000000004017d1d2 going to sleep for 11 seconds 00000100:00100000:2.0:1789264099.468172:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322678016 00000100:00100000:2.0:1789264099.468177:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322678016 00000100:00100000:2.0:1789264099.468212:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789264099.468219:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000553ae2de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6487:x1876179322678016:12345-0@lo:256: 20000000:01000000:2.0:1789264099.468232:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789264099.468247:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789264099.468250:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789264099.468332:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000553ae2de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6487:x1876179322678016:12345-0@lo:256: Request processed in 114us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264099.468339:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789264099.468842:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c55ae5d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322678016:0@lo:256: 10000000:01000000:3.0:1789264099.468887:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789264099.468894:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 0000000038bee26f/0xecaf9f2f14ed68ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68b3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.468901:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 0000000038bee26f/0xecaf9f2f14ed68ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68b3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264099.468910:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789264099.468912:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3aae2b1800 from 1 10000000:01000000:3.0:1789264099.468914:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789264099.468936:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000048c7b8e/0xecaf9f2f14ed68ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.468942:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000048c7b8e/0xecaf9f2f14ed68ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.468950:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000048c7b8e/0xecaf9f2f14ed68ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264099.468969:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c55ae5d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322678144:0@lo:101: 00000100:00100000:3.0:1789264099.468998:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.469029:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 000000004017d1d2 going to sleep for 11 seconds 00000100:00100000:2.0:1789264099.469305:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322678144 00000100:00100000:2.0:1789264099.469311:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322678144 00000100:00100000:2.0:1789264099.469340:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789264099.469354:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087a4724c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+12:6487:x1876179322678144:12345-0@lo:101: 00010000:00010000:2.0:1789264099.469363:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264099.469383:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009c8c67de/0xecaf9f2f14ed68c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed68ba expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264099.469401:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009c8c67de/0xecaf9f2f14ed68c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68ba expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264099.469409:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009c8c67de/0xecaf9f2f14ed68c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68ba expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264099.469416:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009c8c67de, rc 0) 00000100:00100000:2.0:1789264099.469448:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087a4724c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:6487:x1876179322678144:12345-0@lo:101: Request processed in 95us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264099.469454:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789264099.469786:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c55ae5d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322678144:0@lo:101: 00010000:00010000:3.0:1789264099.469805:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000048c7b8e/0xecaf9f2f14ed68ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68c1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.469813:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000048c7b8e/0xecaf9f2f14ed68ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed68c1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264099.469867:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c55ae5d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322678272:0@lo:501: 00000100:00100000:3.0:1789264099.469894:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264099.469909:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322678272 00000100:00100000:3.0:1789264099.469911:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 000000004017d1d2 going to sleep for 11 seconds 00000100:00100000:1.0:1789264099.469914:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322678272 00000100:00100000:1.0:1789264099.469944:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789264099.469951:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047597a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:6487:x1876179322678272:12345-0@lo:501: 00000100:00100000:1.0:1789264099.470057:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047597a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:6487:x1876179322678272:12345-0@lo:501: Request processed in 107us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264099.470064:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789264099.470125:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c55ae5d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322678272:0@lo:501: 00000100:00100000:3.0:1789264099.470214:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c55ae5d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322678400:0@lo:503: 00000100:00100000:3.0:1789264099.470250:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.470308:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 000000004017d1d2 going to sleep for 11 seconds 00000100:00100000:2.0:1789264099.470337:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322678400 00000100:00100000:2.0:1789264099.470341:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322678400 00000100:00100000:2.0:1789264099.470405:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789264099.470412:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2a7ae2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:6487:x1876179322678400:12345-0@lo:503: 00000100:00100000:2.0:1789264099.470494:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2a7ae2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:6487:x1876179322678400:12345-0@lo:503: Request processed in 83us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264099.470500:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789264099.470795:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c55ae5d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322678400:0@lo:503: 00000100:00100000:3.0:1789264099.471882:0:8103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d120cb7c pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8103:1876179322678528:0@lo:502: 00000100:00100000:3.0:1789264099.471934:0:8103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.472031:0:8103:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b4aaf40 going to sleep for 11 seconds 00000100:00100000:0.0:1789264099.472252:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322678528 00000100:00100000:0.0:1789264099.472258:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322678528 00000100:00100000:0.0:1789264099.472300:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789264099.472306:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e8652d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:8103:x1876179322678528:12345-0@lo:502: 00000100:00100000:0.0:1789264099.472653:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e8652d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:8103:x1876179322678528:12345-0@lo:502: Request processed in 347us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264099.472661:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789264099.472736:0:8103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d120cb7c pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8103:1876179322678528:0@lo:502: 00000020:01000000:3.0:1789264099.472788:0:8103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264099.472798:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264099.472800:0:8103:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789264099.472806:0:8103:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c3aae2b1800 00000020:00000080:3.0:1789264099.472809:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789264099.472850:0:8103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8103:1876179322678656:0@lo:502: 00000100:00100000:3.0:1789264099.472883:0:8103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.472909:0:8103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789264099.472993:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322678656 00000100:00100000:2.0:1789264099.472997:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322678656 00000100:00100000:2.0:1789264099.473022:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789264099.473028:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:8103:x1876179322678656:12345-0@lo:502: 00000100:00100000:2.0:1789264099.473113:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:8103:x1876179322678656:12345-0@lo:502: Request processed in 85us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264099.473129:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789264099.473159:0:8103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8103:1876179322678656:0@lo:502: 00000020:01000000:3.0:1789264099.473182:0:8103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264099.473187:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264099.473188:0:8103:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789264099.473191:0:8103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789264099.473405:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789264099.473425:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789264099.473434:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed68ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68c1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264099.473445:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed68ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68c1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264099.473454:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789264099.473457:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3a89eb9800 from 21 10000000:01000000:0.0:1789264099.473470:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789264099.473493:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264099.473501:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264099.473511:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264099.473523:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322678784:0@lo:101: 00000100:00100000:0.0:1789264099.473551:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264099.473573:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789264099.473718:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322678784 00000100:00100000:1.0:1789264099.473723:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322678784 00000100:00100000:1.0:1789264099.473781:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789264099.473789:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:6487:x1876179322678784:12345-0@lo:101: 00010000:00010000:1.0:1789264099.473797:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264099.473810:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed68cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed68c8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264099.473829:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed68cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68c8 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264099.473838:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed68cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68c8 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264099.473846:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f095000, rc 0) 00000100:00100000:1.0:1789264099.473876:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:6487:x1876179322678784:12345-0@lo:101: Request processed in 88us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264099.473881:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789264099.474003:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322678784:0@lo:101: 00010000:00010000:0.0:1789264099.474015:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68cf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264099.474024:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed68cf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264099.474071:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322678912:0@lo:501: 00000100:00100000:0.0:1789264099.474107:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264099.474168:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.474248:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322678912 00000100:00100000:3.0:1789264099.474252:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322678912 00000100:00100000:3.0:1789264099.474282:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789264099.474289:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:6487:x1876179322678912:12345-0@lo:501: 00000100:00100000:3.0:1789264099.474542:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:6487:x1876179322678912:12345-0@lo:501: Request processed in 253us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264099.474550:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789264099.474599:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322678912:0@lo:501: 00000100:00100000:0.0:1789264099.474625:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322679040:0@lo:503: 00000100:00100000:0.0:1789264099.474660:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264099.474709:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.474737:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322679040 00000100:00100000:3.0:1789264099.474861:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322679040 00000100:00100000:3.0:1789264099.474922:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789264099.474929:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:6487:x1876179322679040:12345-0@lo:503: 00000100:00100000:3.0:1789264099.475011:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:6487:x1876179322679040:12345-0@lo:503: Request processed in 81us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264099.475018:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789264099.475076:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322679040:0@lo:503: 00000100:00100000:3.0:1789264099.475497:0:8105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8105:1876179322679168:0@lo:502: 00000100:00100000:3.0:1789264099.475532:0:8105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.475589:0:8105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264099.475618:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322679168 00000100:00100000:0.0:1789264099.475623:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322679168 00000100:00100000:0.0:1789264099.475679:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789264099.475686:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8105:x1876179322679168:12345-0@lo:502: 00000100:00100000:0.0:1789264099.475790:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8105:x1876179322679168:12345-0@lo:502: Request processed in 103us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264099.475797:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789264099.475864:0:8105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8105:1876179322679168:0@lo:502: 00000100:00100000:3.0:1789264099.475900:0:8105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8105:1876179322679296:0@lo:502: 00000100:00100000:3.0:1789264099.475930:0:8105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264099.476064:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322679296 00000100:00100000:1.0:1789264099.476069:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322679296 00000100:00100000:1.0:1789264099.476105:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789264099.476112:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8105:x1876179322679296:12345-0@lo:502: 00000100:00100000:1.0:1789264099.476173:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8105:x1876179322679296:12345-0@lo:502: Request processed in 61us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264099.476179:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789264099.476504:0:8105:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.476518:0:8105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8105:1876179322679296:0@lo:502: 00000040:00080000:3.0:1789264099.476543:0:8105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789264099.476689:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789264099.476708:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789264099.476717:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68cf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264099.476727:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68cf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264099.476736:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789264099.476739:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c3a89eb9800 from 4 10000000:01000000:0.0:1789264099.476832:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789264099.476859:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264099.476867:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264099.476875:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264099.476888:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322679424:0@lo:101: 00000100:00100000:0.0:1789264099.476915:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264099.476974:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b7540 going to sleep for 11 seconds 00000100:00100000:1.0:1789264099.477002:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322679424 00000100:00100000:1.0:1789264099.477007:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322679424 00000100:00100000:1.0:1789264099.477059:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789264099.477066:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:6487:x1876179322679424:12345-0@lo:101: 00010000:00010000:1.0:1789264099.477080:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264099.477176:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f095800/0xecaf9f2f14ed68dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed68d6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264099.477196:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f095800/0xecaf9f2f14ed68dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68d6 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264099.477207:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f095800/0xecaf9f2f14ed68dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68d6 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264099.477214:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f095800, rc 0) 00000100:00100000:1.0:1789264099.477256:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:6487:x1876179322679424:12345-0@lo:101: Request processed in 190us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264099.477262:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789264099.477325:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322679424:0@lo:101: 00010000:00010000:3.0:1789264099.477337:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.477346:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed68dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264099.477398:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322679552:0@lo:256: 00000100:00100000:3.0:1789264099.477426:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.477578:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264099.477608:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322679552 00000100:00100000:0.0:1789264099.477613:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322679552 00000100:00100000:0.0:1789264099.477632:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789264099.477637:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:6487:x1876179322679552:12345-0@lo:256: 20000000:01000000:0.0:1789264099.477649:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789264099.477664:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789264099.477667:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789264099.477737:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:6487:x1876179322679552:12345-0@lo:256: Request processed in 99us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264099.477762:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789264099.477894:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322679552:0@lo:256: 10000000:01000000:3.0:1789264099.477931:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789264099.477937:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.477945:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264099.477952:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789264099.477954:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789264099.477957:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789264099.477971:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.477978:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.477995:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264099.478006:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322679680:0@lo:101: 00000100:00100000:3.0:1789264099.478031:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.478086:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264099.478116:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322679680 00000100:00100000:0.0:1789264099.478120:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322679680 00000100:00100000:0.0:1789264099.478175:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789264099.478183:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:6487:x1876179322679680:12345-0@lo:101: 00010000:00010000:0.0:1789264099.478190:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264099.478198:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed68eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed68e4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264099.478211:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed68eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68e4 expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264099.478218:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed68eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68e4 expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264099.478224:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a80031a00, rc 0) 00000100:00100000:0.0:1789264099.478289:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322679680:12345-0@lo:101: Request processed in 107us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264099.478296:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789264099.478433:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322679680:0@lo:101: 00010000:00010000:3.0:1789264099.478443:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.478451:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed68eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264099.478495:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322679808:0@lo:501: 00000100:00100000:3.0:1789264099.478520:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.478540:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264099.478580:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322679808 00000100:00100000:1.0:1789264099.478584:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322679808 00000100:00100000:1.0:1789264099.478614:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789264099.478621:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322679808:12345-0@lo:501: 00000100:00100000:1.0:1789264099.478717:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322679808:12345-0@lo:501: Request processed in 96us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264099.478723:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789264099.478824:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322679808:0@lo:501: 00000100:00100000:3.0:1789264099.478848:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322679936:0@lo:503: 00000100:00100000:3.0:1789264099.478881:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.478905:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264099.478942:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322679936 00000100:00100000:1.0:1789264099.478946:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322679936 00000100:00100000:1.0:1789264099.479001:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789264099.479008:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aaa0bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322679936:12345-0@lo:503: 00000100:00100000:1.0:1789264099.479082:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aaa0bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322679936:12345-0@lo:503: Request processed in 74us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264099.479089:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789264099.479238:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322679936:0@lo:503: 00000100:00100000:1.0:1789264099.479579:0:8106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8106:1876179322680064:0@lo:502: 00000100:00100000:1.0:1789264099.479612:0:8106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264099.479659:0:8106:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a90601840 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.479694:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322680064 00000100:00100000:3.0:1789264099.479699:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322680064 00000100:00100000:3.0:1789264099.479768:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789264099.479775:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aaa0b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8106:x1876179322680064:12345-0@lo:502: 00000100:00100000:3.0:1789264099.479850:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aaa0b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8106:x1876179322680064:12345-0@lo:502: Request processed in 75us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264099.479856:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789264099.479992:0:8106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8106:1876179322680064:0@lo:502: 00000020:01000000:3.0:1789264099.480014:0:8106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264099.480023:0:8106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264099.480025:0:8106:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789264099.480029:0:8106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789264099.480033:0:8106:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:00000080:3.0:1789264099.480053:0:8106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789264099.480077:0:8106:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c3aba8ecd28) 00000020:00000080:3.0:1789264099.480095:0:8106:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1789264099.480102:0:8106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789264099.480167:0:8106:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789264099.480173:0:8106:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789264099.480180:0:8106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed68f9 00010000:00080000:3.0:1789264099.480205:0:8106:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3aaa1fb000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:3.0:1789264099.481983:0:8106:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1789264099.482817:0:8106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789264099.482830:0:8106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789264099.482859:0:8106:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789264099.482877:0:8106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xecaf9f2f14ed6900 00000100:00080000:3.0:1789264099.482885:0:8106:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789264099.482891:0:8106:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c3aaa1fb000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1789264099.482919:0:8106:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3a8f348700 x1876179322680192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789264099.482946:0:8106:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789264099.482998:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322680192:0@lo:38: 00000100:00100000:3.0:1789264099.483049:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322680320:0@lo:400: 00000100:00100000:0.0:1789264099.483068:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.483081:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264099.483115:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322680192 00000100:00100000:3.0:1789264099.483116:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322680448:0@lo:400: 00000100:00100000:0.0:1789264099.483120:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322680192 00000100:00100000:3.0:1789264099.483138:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.483151:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789264099.483154:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322680448 00000100:00100000:3.0:1789264099.483156:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322680576:0@lo:400: 00000100:00100000:0.0:1789264099.483157:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322680448 00000100:00100000:3.0:1789264099.483177:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264099.483184:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789264099.483191:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3621:x1876179322680192:12345-0@lo:38: 00000100:00100000:3.0:1789264099.483202:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322680320 00000100:00100000:3.0:1789264099.483205:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322680320 00010000:00080000:0.0:1789264099.483211:0:6496:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000100:00100000:3.0:1789264099.483231:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322680576 00000100:00100000:3.0:1789264099.483234:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322680576 00000020:00000080:0.0:1789264099.483237:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xecaf9f2f14ed6907 00000100:00100000:3.0:1789264099.483250:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000004:00100000:0.0:1789264099.483250:0:6496:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789264099.483255:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789264099.483257:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322680320:12345-0@lo:400: 00000100:00100000:3.0:1789264099.483296:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322680320:12345-0@lo:400: Request processed in 40us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264099.483303:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789264099.483316:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789264099.483398:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322680576:12345-0@lo:400: 00000100:00100000:3.0:1789264099.483439:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322680576:12345-0@lo:400: Request processed in 43us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264099.483445:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789264099.483485:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c3a8f349c00 x1876179322680320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264099.483496:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322680320:0@lo:400: 00000040:01000000:3.0:1789264099.483528:0:8106:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:01000000:3.0:1789264099.483664:0:8106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264099.483668:0:8106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264099.483670:0:8106:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789264099.483678:0:8106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264099.483682:0:8106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264099.483683:0:8106:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789264099.483687:0:8106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789264099.483688:0:8106:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789264099.483711:0:8106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8106:1876179322680704:0@lo:502: 00000100:00100000:3.0:1789264099.483790:0:8106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.483821:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322680704 00000100:00100000:3.0:1789264099.483825:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322680704 00000100:00100000:3.0:1789264099.483851:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789264099.483857:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8106:x1876179322680704:12345-0@lo:502: 00000100:00100000:3.0:1789264099.483931:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8106:x1876179322680704:12345-0@lo:502: Request processed in 74us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264099.483938:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789264099.483972:0:8106:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.483985:0:8106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8106:1876179322680704:0@lo:502: 00000020:01000000:3.0:1789264099.484004:0:8106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264099.484007:0:8106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264099.484009:0:8106:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789264099.484012:0:8106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1789264099.484053:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789264099.484070:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789264099.484079:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.484090:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed68eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264099.484099:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789264099.484105:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3a89eb9800 from 1 10000000:01000000:3.0:1789264099.484108:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789264099.484128:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.484136:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.484144:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264099.484156:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322680832:0@lo:101: 00000100:00100000:3.0:1789264099.484183:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.484197:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.484210:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322680832 00000100:00100000:3.0:1789264099.484214:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322680832 00000100:00100000:3.0:1789264099.484235:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789264099.484241:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322680832:12345-0@lo:101: 00010000:00010000:3.0:1789264099.484249:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264099.484260:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6915 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed690e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.484279:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed690e expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.484289:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed690e expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.484298:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a800, rc 0) 00000100:00100000:3.0:1789264099.484471:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322680832:12345-0@lo:101: Request processed in 82us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264099.484484:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789264099.484519:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322680832:0@lo:101: 00010000:00010000:3.0:1789264099.484530:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6915 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.484539:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6915 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264099.484579:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322680960:0@lo:501: 00000100:00100000:3.0:1789264099.484602:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.484614:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.484623:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322680960 00000100:00100000:3.0:1789264099.484626:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322680960 00000100:00100000:3.0:1789264099.484643:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789264099.484648:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322680960:12345-0@lo:501: 00000100:00100000:3.0:1789264099.484728:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322680960:12345-0@lo:501: Request processed in 78us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264099.484734:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789264099.484784:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322680960:0@lo:501: 00000100:00100000:3.0:1789264099.484806:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322681088:0@lo:503: 00000100:00100000:3.0:1789264099.484839:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.484856:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.484866:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322681088 00000100:00100000:3.0:1789264099.484869:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322681088 00000100:00100000:3.0:1789264099.484887:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789264099.484892:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322681088:12345-0@lo:503: 00000100:00100000:3.0:1789264099.484962:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322681088:12345-0@lo:503: Request processed in 68us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264099.484968:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789264099.485002:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322681088:0@lo:503: 00000100:00080000:3.0:1789264099.485536:0:8110:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9c3a8f349c00 x1876179322681216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264099.485545:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d6c0 going to sleep for 0 seconds 00010000:00080000:0.0:1789264099.486477:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c3a8f348380 x1876179322680576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264099.486490:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322680576:0@lo:400: 00000100:00100000:0.0:1789264099.486886:0:8111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8111:1876179322681344:0@lo:502: 00000100:00100000:0.0:1789264099.486944:0:8111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264099.486973:0:8111:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.487050:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322681344 00000100:00100000:3.0:1789264099.487056:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322681344 00000100:00100000:3.0:1789264099.487087:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789264099.487095:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:8111:x1876179322681344:12345-0@lo:502: 00000100:00100000:3.0:1789264099.487221:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:8111:x1876179322681344:12345-0@lo:502: Request processed in 126us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264099.487228:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789264099.487286:0:8111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8111:1876179322681344:0@lo:502: 00000020:01000000:0.0:1789264099.487307:0:8111:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789264099.487316:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264099.487388:0:8111:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789264099.487397:0:8111:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c3a89eb9800 00000020:00000080:0.0:1789264099.487399:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789264099.487428:0:8111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8111:1876179322681472:0@lo:502: 00000100:00100000:0.0:1789264099.487457:0:8111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264099.487482:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322681472 00000100:00100000:0.0:1789264099.487486:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322681472 00000100:00100000:0.0:1789264099.487514:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789264099.487521:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:8111:x1876179322681472:12345-0@lo:502: 00000100:00100000:0.0:1789264099.487595:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:8111:x1876179322681472:12345-0@lo:502: Request processed in 73us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264099.487601:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789264099.487631:0:8111:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b7540 going to sleep for 11 seconds 00000100:00100000:0.0:1789264099.487655:0:8111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8111:1876179322681472:0@lo:502: 00000020:01000000:0.0:1789264099.487672:0:8111:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264099.487675:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264099.487677:0:8111:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789264099.487680:0:8111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789264099.487767:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789264099.487788:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789264099.487797:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6915 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.487806:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6915 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264099.487814:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789264099.487817:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c3aaa494d28 from 1 10000000:01000000:3.0:1789264099.487820:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789264099.487841:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.487859:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.487869:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264099.487882:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f34b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322681600:0@lo:101: 00000100:00100000:3.0:1789264099.487910:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.487923:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.487935:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322681600 00000100:00100000:3.0:1789264099.487938:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322681600 00000100:00100000:3.0:1789264099.487958:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789264099.487965:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322681600:12345-0@lo:101: 00010000:00010000:3.0:1789264099.487972:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264099.487982:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6923 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed691c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.488001:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed691c expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.488011:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed691c expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.488019:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36ac00, rc 0) 00000100:00100000:3.0:1789264099.488042:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322681600:12345-0@lo:101: Request processed in 78us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264099.488048:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789264099.488072:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f34b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322681600:0@lo:101: 00010000:00010000:3.0:1789264099.488087:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6923 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.488095:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6923 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264099.488138:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f34b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322681728:0@lo:501: 00000100:00100000:3.0:1789264099.488163:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.488182:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.488194:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322681728 00000100:00100000:3.0:1789264099.488198:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322681728 00000100:00100000:3.0:1789264099.488218:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789264099.488224:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322681728:12345-0@lo:501: 00000100:00100000:3.0:1789264099.488279:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322681728:12345-0@lo:501: Request processed in 54us (115us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789264099.488286:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1789264099.488926:0:6496:0:(import.c:65:import_set_state_nolock()) ffff9c3aba910800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789264099.488980:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1876179322680192:12345-0@lo:38: Request processed in 5788us (5911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264099.488989:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789264099.489004:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1789264099.489010:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789264099.489017:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00100000:1.0:1789264099.489021:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322680448:12345-0@lo:400: 00000100:00080000:0.0:1789264099.489028:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789264099.489035:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789264099.489038:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa1fb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789264099.489059:0:3621:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000075dd6172): req@ffff9c3a8f349c00 x1876179322681216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264099.489068:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322680448:12345-0@lo:400: Request processed in 48us (5927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264099.489078:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789264099.489149:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f34b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322681728:0@lo:501: 10000000:01000000:3.0:1789264099.489178:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789264099.489188:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6923 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264099.489195:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6923 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264099.489851:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322681856:0@lo:41: 00000100:00100000:1.0:1789264099.489890:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.489958:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322681856 00000100:00100000:3.0:1789264099.489963:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322681856 00000100:00100000:3.0:1789264099.490034:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789264099.490042:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1876179322681856:12345-0@lo:41: 00000004:00000024:3.0:1789264099.490068:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789264099.490127:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1876179322681856:12345-0@lo:41: Request processed in 86us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264099.490134:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789264099.490211:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322681856:0@lo:41: 00000100:00100000:0.0:1789264099.490361:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322680192:0@lo:38: 00000100:00100000:0.0:1789264099.490404:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322680448:0@lo:400: 00000100:00100000:3.0:1789264099.490448:0:8110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.490506:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264099.490540:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322681216 00000100:00100000:1.0:1789264099.490544:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322681216 00000100:00100000:1.0:1789264099.490599:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789264099.490606:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8110:x1876179322681216:12345-0@lo:1000: 00000100:00100000:1.0:1789264099.490672:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8110:x1876179322681216:12345-0@lo:1000: Request processed in 66us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264099.490679:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789264099.490698:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8110:1876179322681216:0@lo:1000: 00000040:01000000:0.0:1789264099.490726:0:8110:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789264099.490772:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a3800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8110:1876179322681984:0@lo:1000: 00000100:00100000:0.0:1789264099.490801:0:8110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264099.490824:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.490838:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322681984 00000100:00100000:3.0:1789264099.490844:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322681984 00000100:00100000:3.0:1789264099.490869:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789264099.490875:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8110:x1876179322681984:12345-0@lo:1000: 00000100:00100000:3.0:1789264099.490977:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8110:x1876179322681984:12345-0@lo:1000: Request processed in 100us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264099.490983:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a3800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8110:1876179322681984:0@lo:1000: 00000100:00100000:3.0:1789264099.490988:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789264099.491027:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a3800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8110:1876179322682112:0@lo:700: 00000100:00100000:0.0:1789264099.491058:0:8110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264099.491081:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.491212:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322682112 00000100:00100000:3.0:1789264099.491217:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322682112 00000100:00100000:3.0:1789264099.491251:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789264099.491258:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:8110:x1876179322682112:12345-0@lo:700: 00000100:00100000:3.0:1789264099.491339:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:8110:x1876179322682112:12345-0@lo:700: Request processed in 81us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264099.491345:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789264099.491428:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a3800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8110:1876179322682112:0@lo:700: 00000100:00100000:1.0:1789264099.491600:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23dc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8110:1876179322682240:0@lo:1000: 00000100:00100000:1.0:1789264099.491625:0:8110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264099.491676:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a307300 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.491708:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322682240 00000100:00100000:3.0:1789264099.491712:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322682240 00000100:00100000:3.0:1789264099.491847:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789264099.491855:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8110:x1876179322682240:12345-0@lo:1000: 00000100:00100000:3.0:1789264099.491902:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8110:x1876179322682240:12345-0@lo:1000: Request processed in 48us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264099.491917:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789264099.492011:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23dc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8110:1876179322682240:0@lo:1000: 00000004:00080000:3.0:1789264099.492047:0:8110:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9c3a8f332540 with version 0 00000020:00100000:3.0:1789264099.492059:0:8110:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789264099.492066:0:8110:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c3a8f348a80 x1876179322682496/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789264099.492079:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8110:1876179322682496:0@lo:1000: 00000100:00100000:3.0:1789264099.492102:0:8110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.492153:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789264099.492182:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322682496 00000100:00100000:1.0:1789264099.492191:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322682496 00000100:00100000:1.0:1789264099.492248:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789264099.492254:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8110:x1876179322682496:12345-0@lo:1000: 00000001:00080000:0.0:1789264099.493774:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1789264099.493785:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789264099.494006:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8110:x1876179322682496:12345-0@lo:1000: Request processed in 1750us (1900us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789264099.494015:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1789264099.494105:0:8110:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1789264099.494110:0:8110:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789264099.494122:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8110:1876179322682496:0@lo:1000: 00000100:00100000:3.0:1789264099.494190:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8110:1876179322682624:0@lo:1000: 00000100:00100000:3.0:1789264099.494221:0:8110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264099.494282:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264099.494317:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322682624 00000100:00100000:0.0:1789264099.494322:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322682624 00000100:00100000:0.0:1789264099.494395:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789264099.494404:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8110:x1876179322682624:12345-0@lo:1000: 00000100:00100000:0.0:1789264099.494469:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8110:x1876179322682624:12345-0@lo:1000: Request processed in 66us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264099.494476:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789264099.494522:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8110:1876179322682624:0@lo:1000: 00000040:00080000:3.0:1789264099.494537:0:8110:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789264099.494564:0:8110:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9c3ab7f4d000 with version 1 00000040:00080000:3.0:1789264099.496658:0:8110:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789264099.496730:0:8110:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789264099.496735:0:8110:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:0.0:1789264099.497437:0:8108:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c3ab7f4d600 version 1 rpc_version 1 00000020:00100000:0.0:1789264099.497472:0:8108:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789264099.497482:0:8108:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c3aa98a2300 x1876179322682880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789264099.497502:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a2300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8108:1876179322682880:0@lo:1000: 00000100:00100000:0.0:1789264099.497558:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264099.497603:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b7900 going to sleep for 11 seconds 00000100:00100000:3.0:1789264099.498048:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322682880 00000100:00100000:3.0:1789264099.498056:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322682880 00000100:00100000:3.0:1789264099.498109:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789264099.498119:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8108:x1876179322682880:12345-0@lo:1000: 00000001:00080000:0.0:1789264099.502516:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1789264099.502887:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8108:x1876179322682880:12345-0@lo:1000: Request processed in 4765us (5323us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789264099.502900:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1789264099.502923:0:8108:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789264099.502929:0:8108:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789264099.502946:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a2300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8108:1876179322682880:0@lo:1000: 00010000:00010000:0.0:1789264099.978014:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264101.001975:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264102.027168:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789264102.318562:0:8397:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789264102.318566:0:8397:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789264102.318568:0:8397:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789264102.318701:0:8397:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c3aba913000 00000020:01000004:1.0:1789264102.318715:0:8397:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789264102.318726:0:8397:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789264102.318739:0:8397:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c3ab6814d28) 00000020:00000080:1.0:1789264102.318774:0:8397:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789264102.342246:0:8397:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789264102.342291:0:8397:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1789264102.353183:0:8397:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789264102.353388:0:8397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789264102.353399:0:8397:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789264102.353408:0:8397:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xecaf9f2f14ed6931 00000020:01000004:3.0:1789264102.353415:0:8397:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789264102.353435:0:8397:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.144@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789264102.353439:0:8397:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789264102.353445:0:8397:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789264102.353449:0:8397:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789264102.353460:0:8397:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c3aba8e8000) 00000020:00000080:3.0:1789264102.353470:0:8397:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1789264102.354969:0:8397:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789264102.355214:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789264102.355221:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789264102.357534:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789264102.357545:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789264102.360328:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789264102.360340:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789264102.364157:0:8397:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789264102.364289:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789264102.364293:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789264102.364939:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789264102.364951:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789264102.383407:0:8397:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789264102.383785:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789264102.383793:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789264102.384557:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789264102.384564:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789264102.386107:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789264102.386119:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789264102.389196:0:8397:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789264102.389441:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789264102.389447:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789264102.390150:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789264102.390156:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789264102.409959:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322683008:0@lo:41: 00000100:00100000:0.0:1789264102.410024:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264102.410088:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322683008 00000100:00100000:1.0:1789264102.410099:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322683008 00000100:00100000:1.0:1789264102.410177:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789264102.410187:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322683008:12345-0@lo:41: 00000004:00000024:1.0:1789264102.410222:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1789264102.410285:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322683008:12345-0@lo:41: Request processed in 98us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264102.410294:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789264102.410429:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322683008:0@lo:41: 00000100:00100000:3.0:1789264102.432435:0:8397:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789264102.432635:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789264102.432648:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789264102.433718:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789264102.433727:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789264102.434173:0:8397:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789264102.434198:0:8397:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789264102.434203:0:8397:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789264102.450454:0:8397:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789264102.450488:0:8397:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.144@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789264102.450492:0:8397:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789264102.450493:0:8397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789264102.450495:0:8397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789264102.450496:0:8397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789264102.450497:0:8397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789264102.450498:0:8397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789264102.450500:0:8397:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789264102.450501:0:8397:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789264102.450502:0:8397:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789264102.450504:0:8397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789264102.450505:0:8397:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789264102.450508:0:8397:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789264102.450510:0:8397:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789264102.450511:0:8397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789264102.450512:0:8397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789264102.450513:0:8397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789264102.450514:0:8397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789264102.450515:0:8397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789264102.450516:0:8397:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789264102.450517:0:8397:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789264102.450518:0:8397:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789264102.450519:0:8397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789264102.450520:0:8397:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789264102.450542:0:8397:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789264102.450558:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322683136:0@lo:253: 00000100:00100000:2.0:1789264102.450618:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264102.450778:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a90601240 going to sleep for 11 seconds 00000100:00100000:3.0:1789264102.450856:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322683136 00000100:00100000:3.0:1789264102.450863:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322683136 00000100:00100000:3.0:1789264102.450905:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789264102.450912:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:8397:x1876179322683136:12345-0@lo:253: 20000000:01000000:3.0:1789264102.450947:0:6484:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789264102.450950:0:6484:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789264102.450955:0:6484:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789264102.450958:0:6484:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789264102.451127:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789264102.451224:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789264102.451237:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789264102.451251:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789264102.451255:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789264102.451265:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789264102.451287:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789264102.451368:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789264102.451381:0:6484:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.144@tcp 20000000:01000000:3.0:1789264102.451384:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:3.0:1789264102.451396:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789264102.451400:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789264102.451412:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789264102.451417:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:3.0:1789264102.451427:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789264102.451432:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789264102.451447:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789264102.451475:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789264102.451530:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789264102.451539:0:6484:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.144@tcp 20000000:01000000:3.0:1789264102.451541:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:3.0:1789264102.451551:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789264102.451555:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789264102.451564:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789264102.451568:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:3.0:1789264102.451578:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789264102.451583:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789264102.451592:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789264102.451603:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789264102.451993:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789264102.452005:0:6484:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.144@tcp 20000000:01000000:3.0:1789264102.452007:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:3.0:1789264102.452021:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789264102.452027:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789264102.452039:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789264102.452044:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:3.0:1789264102.452683:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789264102.452695:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789264102.452709:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789264102.452725:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789264102.452739:0:6484:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789264102.452770:0:6484:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789264102.452774:0:6484:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789264102.452829:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789264102.452832:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789264102.453318:0:8416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789264102.453555:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789264102.453576:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789264102.453591:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789264102.453599:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789264102.453607:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789264102.453909:0:8417:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1789264102.453930:0:8417:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1789264102.453943:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1789264102.454068:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1789264102.454087:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1789264102.454100:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1789264102.454106:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789264102.454107:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789264102.454432:0:8418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1789264102.454446:0:8418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1789264102.454455:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789264102.454525:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789264102.454542:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789264102.454554:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789264102.454572:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789264102.454573:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789264102.454879:0:8419:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1789264102.454896:0:8419:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1789264102.454908:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789264102.455014:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1789264102.455034:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1789264102.455067:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:1.0:1789264102.455082:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789264102.455099:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.455115:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed680b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6804 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.455123:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36be00/0xecaf9f2f14ed6882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed687b expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.455129:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed68cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68c8 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.455136:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed68eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68e4 expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.455143:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed691c expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.455150:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.455183:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed691c expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.455197:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6923 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed691c expref: 18 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.455210:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876179322683264:0@lo:104: 00000100:00100000:1.0:1789264102.455266:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789264102.455333:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed68eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed68e4 expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.455341:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed68eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68e4 expref: 18 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.455358:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876179322683392:0@lo:104: 00000100:00100000:1.0:1789264102.455381:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789264102.455412:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed68cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed68c8 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.455420:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed68cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68c8 expref: 18 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.455428:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876179322683520:0@lo:104: 00000100:00100000:1.0:1789264102.455447:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789264102.455461:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36be00/0xecaf9f2f14ed6882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed687b expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.455469:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8a36be00/0xecaf9f2f14ed6882 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed687b expref: 18 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.455477:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876179322683648:0@lo:104: 00000100:00100000:1.0:1789264102.455495:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789264102.455511:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed680b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6804 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.455518:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed680b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6804 expref: 18 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.455525:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876179322683776:0@lo:104: 00000100:00100000:1.0:1789264102.455558:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264102.455579:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2d9b000 going to sleep for 11 seconds 00000100:00100000:0.0:1789264102.455639:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322683264 00000100:00100000:0.0:1789264102.455646:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322683264 00000100:00100000:0.0:1789264102.455675:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322683392 00000100:00100000:0.0:1789264102.455678:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322683392 00000100:00100000:0.0:1789264102.455687:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322683520 00000100:00100000:0.0:1789264102.455690:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322683520 00000100:00100000:0.0:1789264102.455699:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322683648 00000100:00100000:0.0:1789264102.455701:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322683648 00000100:00100000:0.0:1789264102.455709:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322683776 00000100:00100000:0.0:1789264102.455712:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322683776 00000100:00100000:0.0:1789264102.455724:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264102.455732:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+7:6484:x1876179322683264:12345-0@lo:104: 00010000:00010000:0.0:1789264102.455767:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6923 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.455825:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789264102.455845:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+7:6484:x1876179322683264:12345-0@lo:104: Request processed in 114us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.455852:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264102.455869:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789264102.455875:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+6:6484:x1876179322683392:12345-0@lo:104: 00010000:00010000:0.0:1789264102.455882:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed68eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.455925:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789264102.455930:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+6:6484:x1876179322683392:12345-0@lo:104: Request processed in 56us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.455936:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789264102.455948:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789264102.455954:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:6484:x1876179322683520:12345-0@lo:104: 00010000:00010000:0.0:1789264102.455961:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed68cf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.455991:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789264102.455997:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:6484:x1876179322683520:12345-0@lo:104: Request processed in 44us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.456002:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789264102.456014:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789264102.456021:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:6484:x1876179322683648:12345-0@lo:104: 00010000:00010000:0.0:1789264102.456027:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a80030600/0xecaf9f2f14ed687b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6882 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456051:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789264102.456060:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:6484:x1876179322683648:12345-0@lo:104: Request processed in 41us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.456066:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789264102.456078:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789264102.456084:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:6484:x1876179322683776:12345-0@lo:104: 00010000:00010000:0.0:1789264102.456091:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed6804 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed680b expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456117:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789264102.456122:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:6484:x1876179322683776:12345-0@lo:104: Request processed in 39us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.456127:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789264102.456142:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789264102.456146:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6923 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456150:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264102.456153:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6923 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456159:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6923 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264102.456164:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6923 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264102.456167:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789264102.456185:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6923 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456196:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264102.456210:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6923 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456215:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed691c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6923 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456223:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789264102.456225:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed68eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456229:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36ae00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264102.456232:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed68eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456239:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed68eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264102.456245:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed68eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264102.456250:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789264102.456268:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456274:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264102.456282:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456288:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed68e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.456301:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876179322683264:0@lo:104: 00010000:00010000:0.0:1789264102.456303:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789264102.456309:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed68cf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.456314:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876179322683392:0@lo:104: 00010000:00010000:0.0:1789264102.456320:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a80030200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264102.456324:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed68cf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.456326:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876179322683520:0@lo:104: 00010000:00010000:0.0:1789264102.456339:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed68cf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.456340:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876179322683648:0@lo:104: 10000000:00010000:0.0:1789264102.456361:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed68cf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.456366:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876179322683776:0@lo:104: 10000000:01000000:0.0:1789264102.456372:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789264102.456390:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68cf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456396:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264102.456399:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456411:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68cf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456419:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed68c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68cf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456430:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789264102.456433:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a80030600/0xecaf9f2f14ed687b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6882 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456449:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a80030600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264102.456452:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80030600/0xecaf9f2f14ed687b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6882 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456458:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a80030600/0xecaf9f2f14ed687b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6882 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264102.456464:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80030600/0xecaf9f2f14ed687b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6882 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264102.456469:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789264102.456481:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a80030600/0xecaf9f2f14ed687b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6882 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456486:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264102.456491:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a80030600/0xecaf9f2f14ed687b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6882 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456498:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a80030600/0xecaf9f2f14ed687b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6882 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456507:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264102.456510:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed6804 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed680b expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456516:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264102.456518:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed6804 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed680b expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456535:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed6804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed680b expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264102.456541:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed6804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed680b expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264102.456546:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789264102.456559:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed6804 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed680b expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456564:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264102.456568:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed6804 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed680b expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456574:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed6804 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed680b expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.456586:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264102.456588:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264102.456589:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264102.456597:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264102.456607:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322683904:0@lo:103: 00000100:00100000:0.0:1789264102.456636:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264102.456666:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322684416:0@lo:103: 00000100:00100000:1.0:1789264102.456680:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322683904 00000100:00100000:0.0:1789264102.456688:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264102.456709:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789264102.456715:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322684032:0@lo:103: 00000100:00100000:0.0:1789264102.456734:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264102.456785:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322684160:0@lo:103: 00000100:00100000:0.0:1789264102.456807:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264102.456812:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322683904 00000100:00100000:0.0:1789264102.456823:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789264102.456829:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322684288:0@lo:103: 00010000:00010000:1.0:1789264102.456838:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6923 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed691c expref: 19 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.456858:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322684416 00000100:00100000:1.0:1789264102.456862:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322684416 00000100:00100000:0.0:1789264102.456867:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789264102.456876:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed680b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6804 expref: 20 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.456889:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322684032 00000100:00100000:1.0:1789264102.456892:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322684032 00000100:00100000:0.0:1789264102.456896:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322684160 00000100:00100000:0.0:1789264102.456901:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322684160 00010000:00010000:1.0:1789264102.456903:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed68eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68e4 expref: 21 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.456916:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322684288 00000100:00100000:1.0:1789264102.456918:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322684288 00010000:00010000:0.0:1789264102.456921:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed68cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68c8 expref: 22 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.456933:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36be00/0xecaf9f2f14ed6882 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed687b expref: 23 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264102.456943:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264102.456955:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:3622:x1876179322683904:12345-0@lo:103: 00000100:00100000:1.0:1789264102.456966:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789264102.456967:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264102.456975:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6923 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed691c expref: 23 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.456977:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:3622:x1876179322684416:12345-0@lo:103: 00010000:00010000:1.0:1789264102.456991:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264102.456993:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed691c expref: 23 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.456998:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed680b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6804 expref: 23 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.457016:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6923 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed691c expref: 23 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.457178:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264102.457194:0:7892:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789264102.457201:0:7892:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1789264102.457322:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed680b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6804 expref: 23 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.457335:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed680b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6804 expref: 23 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264102.457429:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789264102.457455:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:3622:x1876179322684032:12345-0@lo:103: 00010000:00010000:2.0:1789264102.457471:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264102.457475:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed68eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68e4 expref: 22 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457485:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed68eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68e4 expref: 22 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457495:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed68eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed68e4 expref: 22 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457504:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264102.457530:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:3622:x1876179322684032:12345-0@lo:103: Request processed in 96us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264102.457535:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789264102.457545:0:7892:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1789264102.457550:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789264102.457557:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:3624:x1876179322684160:12345-0@lo:103: 00010000:00010000:2.0:1789264102.457575:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264102.457579:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed68cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68c8 expref: 20 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457588:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed68cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68c8 expref: 20 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457597:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed68cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed68c8 expref: 20 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457606:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264102.457630:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:3624:x1876179322684160:12345-0@lo:103: Request processed in 75us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264102.457641:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789264102.457649:0:7892:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1789264102.457653:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789264102.457657:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2787c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:3624:x1876179322684288:12345-0@lo:103: 00010000:00010000:2.0:1789264102.457662:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264102.457665:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36be00/0xecaf9f2f14ed6882 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed687b expref: 18 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457671:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36be00/0xecaf9f2f14ed6882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed687b expref: 18 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457677:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36be00/0xecaf9f2f14ed6882 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed687b expref: 18 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457684:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457692:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457703:0:7892:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457710:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457717:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457724:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457735:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8f095a00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264102.457738:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457762:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457777:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.457787:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264102.457810:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2787c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:3624:x1876179322684288:12345-0@lo:103: Request processed in 152us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264102.457816:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789264102.457927:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264102.457961:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:3622:x1876179322684416:12345-0@lo:103: Request processed in 987us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264102.457967:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789264102.457987:0:6484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.457994:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.458000:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f095a00/0xecaf9f2f14ed693f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789264102.458011:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789264102.458865:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322684032:0@lo:103: 00000100:00100000:1.0:1789264102.458878:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322684416:0@lo:103: 00010000:00010000:0.0:1789264102.459438:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264102.459496:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:3622:x1876179322683904:12345-0@lo:103: Request processed in 2543us (2858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.459503:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789264102.459544:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322683904:0@lo:103: 00000100:00100000:1.0:1789264102.460228:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:8397:x1876179322683136:12345-0@lo:253: Request processed in 9314us (9607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264102.460236:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789264102.460321:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322683136:0@lo:253: 10000000:01000000:2.0:1789264102.460334:0:8397:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789264102.460338:0:8397:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789264102.460339:0:8397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789264102.460340:0:8397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789264102.460342:0:8397:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789264102.460343:0:8397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789264102.460344:0:8397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789264102.460346:0:8397:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789264102.460355:0:8397:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789264102.460358:0:8397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789264102.460359:0:8397:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789264102.460376:0:8397:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c3aba913000 from lustre-OST0000 10000000:01000000:2.0:1789264102.460402:0:8397:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789264102.460405:0:8397:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789264102.460413:0:8397:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c3aaa494d28 local copy 10000000:01000000:2.0:1789264102.460417:0:8397:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789264102.460457:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.460467:0:8397:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.460476:0:8397:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264102.460492:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322684544:0@lo:101: 00000100:00100000:2.0:1789264102.460523:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264102.460555:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a90601f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264102.460718:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322684544 00000100:00100000:1.0:1789264102.460724:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322684544 00000100:00100000:1.0:1789264102.460787:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789264102.460796:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:8397:x1876179322684544:12345-0@lo:101: 00010000:00010000:1.0:1789264102.460807:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264102.460821:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed694d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6946 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.460843:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed694d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6946 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.460854:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed694d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6946 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.460862:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f095400, rc 0) 00000100:00100000:1.0:1789264102.460903:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8397:x1876179322684544:12345-0@lo:101: Request processed in 108us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264102.460910:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789264102.460928:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322684288:0@lo:103: 00000100:00100000:0.0:1789264102.460940:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322684160:0@lo:103: 00000100:00100000:2.0:1789264102.461023:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322684544:0@lo:101: 00010000:00010000:2.0:1789264102.461034:0:8397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xecaf9f2f14ed694d expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.461043:0:8397:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xecaf9f2f14ed694d expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264102.461123:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322684672:0@lo:501: 00000100:00100000:2.0:1789264102.461147:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264102.461278:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a90601f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264102.461309:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322684672 00000100:00100000:1.0:1789264102.461312:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322684672 00000100:00100000:1.0:1789264102.461374:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789264102.461382:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8397:x1876179322684672:12345-0@lo:501: 00000100:00100000:1.0:1789264102.461477:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8397:x1876179322684672:12345-0@lo:501: Request processed in 95us (327us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789264102.461492:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789264102.461533:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322684672:0@lo:501: 10000000:01000000:2.0:1789264102.461543:0:8397:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789264102.461559:0:8397:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789264102.461572:0:8397:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xecaf9f2f14ed694d expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.461580:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xecaf9f2f14ed694d expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.461594:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xecaf9f2f14ed694d expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.461609:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789264102.461632:0:8397:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c3aba913000 10000000:01000000:2.0:1789264102.461637:0:8397:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789264102.461641:0:8397:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789264102.461644:0:8397:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789264102.461648:0:8397:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789264102.461650:0:8397:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789264102.461663:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.461670:0:8397:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.461678:0:8397:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264102.461688:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322684800:0@lo:101: 00000100:00100000:2.0:1789264102.461711:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789264102.461778:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264102.461784:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xecaf9f2f14ed694d expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.461790:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623e00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264102.461794:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xecaf9f2f14ed694d expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.461801:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xecaf9f2f14ed694d expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264102.461809:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xecaf9f2f14ed694d expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264102.461814:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789264102.461828:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xecaf9f2f14ed694d expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.461834:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264102.461847:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xecaf9f2f14ed694d expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.461854:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623e00/0xecaf9f2f14ed6946 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xecaf9f2f14ed694d expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.461863:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264102.461865:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264102.461867:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264102.461874:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322684928:0@lo:103: 00000100:00100000:0.0:1789264102.461897:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264102.461929:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322684928 00000100:00100000:0.0:1789264102.461932:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322684928 00000100:00100000:0.0:1789264102.461968:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789264102.461974:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:3623:x1876179322684928:12345-0@lo:103: 00010000:00010000:0.0:1789264102.461983:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264102.461992:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed694d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6946 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.462004:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264102.462029:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:3623:x1876179322684928:12345-0@lo:103: Request processed in 55us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.462035:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789264102.462066:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322684928:0@lo:103: 00000100:00100000:2.0:1789264102.462299:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a90601840 going to sleep for 11 seconds 00000100:00100000:3.0:1789264102.462347:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322684800 00000100:00100000:3.0:1789264102.462359:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322684800 00000100:00100000:3.0:1789264102.462389:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789264102.462398:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+13:8397:x1876179322684800:12345-0@lo:101: 00010000:00010000:3.0:1789264102.462406:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264102.462416:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed695b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6954 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.462431:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed695b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6954 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.462440:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed695b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6954 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.462447:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a600, rc 0) 00000100:00100000:3.0:1789264102.462486:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8397:x1876179322684800:12345-0@lo:101: Request processed in 91us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264102.462491:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789264102.462562:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322684800:0@lo:101: 00010000:00010000:2.0:1789264102.462574:0:8397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed695b expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.462581:0:8397:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed695b expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264102.462648:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685056:0@lo:501: 00000100:00100000:2.0:1789264102.462672:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264102.462696:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a90601840 going to sleep for 11 seconds 00000100:00100000:1.0:1789264102.462838:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322685056 00000100:00100000:1.0:1789264102.462843:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322685056 00000100:00100000:1.0:1789264102.462872:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789264102.462878:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8397:x1876179322685056:12345-0@lo:501: 00000100:00100000:1.0:1789264102.463253:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8397:x1876179322685056:12345-0@lo:501: Request processed in 374us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264102.463260:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789264102.463314:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685056:0@lo:501: 00000100:00100000:2.0:1789264102.463340:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685184:0@lo:503: 00000100:00100000:2.0:1789264102.463388:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264102.463416:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a90601840 going to sleep for 11 seconds 00000100:00100000:0.0:1789264102.463460:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322685184 00000100:00100000:0.0:1789264102.463464:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322685184 00000100:00100000:0.0:1789264102.463524:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789264102.463531:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8397:x1876179322685184:12345-0@lo:503: 00000100:00100000:0.0:1789264102.463614:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8397:x1876179322685184:12345-0@lo:503: Request processed in 83us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.463620:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789264102.463681:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685184:0@lo:503: 00000040:00080000:2.0:1789264102.463933:0:8397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789264102.464033:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685312:0@lo:502: 00000100:00100000:2.0:1789264102.464069:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264102.464187:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322685312 00000100:00100000:3.0:1789264102.464192:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322685312 00000100:00100000:2.0:1789264102.464210:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a90601840 going to sleep for 11 seconds 00000100:00100000:1.0:1789264102.464387:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789264102.464393:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8397:x1876179322685312:12345-0@lo:502: 00000100:00100000:1.0:1789264102.464626:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8397:x1876179322685312:12345-0@lo:502: Request processed in 233us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264102.464631:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789264102.464690:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685312:0@lo:502: 00000040:00080000:2.0:1789264102.464922:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789264102.465086:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789264102.465105:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789264102.465120:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789264102.465129:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789264102.465136:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789264102.465153:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685440:0@lo:502: 00000100:00100000:2.0:1789264102.465179:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264102.465225:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a90601840 going to sleep for 11 seconds 00000100:00100000:0.0:1789264102.465248:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322685440 00000100:00100000:0.0:1789264102.465255:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322685440 00000100:00100000:0.0:1789264102.465297:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789264102.465302:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8397:x1876179322685440:12345-0@lo:502: 00000100:00100000:0.0:1789264102.465433:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8397:x1876179322685440:12345-0@lo:502: Request processed in 130us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.465440:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789264102.465490:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685440:0@lo:502: 00000040:00080000:1.0:1789264102.465519:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789264102.465524:0:8397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789264102.466096:0:8421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789264102.466103:0:8421:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789264102.466109:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264102.466111:0:8421:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789264102.466116:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789264102.466130:0:8421:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c3ab6810000) 00000020:00000080:1.0:1789264102.466148:0:8421:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789264102.466154:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789264102.466213:0:8421:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3aba913000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789264102.466219:0:8421:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789264102.466223:0:8421:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xecaf9f2f14ed6969 00010000:00010000:1.0:1789264102.469260:0:8421:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1789264102.469899:0:8421:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789264102.471641:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789264102.471988:0:8421:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789264102.474967:0:8421:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789264102.475128:0:8421:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789264102.483206:0:8421:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789264102.484430:0:8421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789264102.484441:0:8421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264102.484447:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264102.484454:0:8421:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789264102.484458:0:8421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264102.484462:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264102.484464:0:8421:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789264102.484468:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789264102.484469:0:8421:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789264102.484489:0:8421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264102.484492:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264102.484494:0:8421:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789264102.484496:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789264102.487069:0:8397:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789264102.487112:0:8397:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789264102.487158:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed695b expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.487170:0:8397:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed695b expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264102.487195:0:8397:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3aba913000 from 1 10000000:01000000:1.0:1789264102.487198:0:8397:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789264102.487231:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.487240:0:8397:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.487251:0:8397:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.487273:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685568:0@lo:101: 00000100:00100000:1.0:1789264102.487362:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264102.487412:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8811fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264102.487536:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322685568 00000100:00100000:0.0:1789264102.487543:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322685568 00000100:00100000:0.0:1789264102.487589:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789264102.487599:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:8397:x1876179322685568:12345-0@lo:101: 00010000:00010000:0.0:1789264102.487612:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264102.487623:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a80030600/0xecaf9f2f14ed6977 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6970 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.487643:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a80030600/0xecaf9f2f14ed6977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6970 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.487654:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a80030600/0xecaf9f2f14ed6977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6970 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.487663:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a80030600, rc 0) 00000100:00100000:0.0:1789264102.487700:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:8397:x1876179322685568:12345-0@lo:101: Request processed in 103us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.487707:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789264102.487868:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685568:0@lo:101: 00010000:00010000:1.0:1789264102.487882:0:8397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6977 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264102.487897:0:8397:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6977 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264102.488268:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685696:0@lo:501: 00000100:00100000:1.0:1789264102.488296:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264102.488332:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8811fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264102.488428:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322685696 00000100:00100000:0.0:1789264102.488432:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322685696 00000100:00100000:0.0:1789264102.488464:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789264102.488471:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:8397:x1876179322685696:12345-0@lo:501: 00000100:00100000:0.0:1789264102.488560:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:8397:x1876179322685696:12345-0@lo:501: Request processed in 89us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.488566:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789264102.488794:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685696:0@lo:501: 00000100:00100000:3.0:1789264102.488824:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685824:0@lo:503: 00000100:00100000:3.0:1789264102.488861:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264102.488889:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789264102.488931:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322685824 00000100:00100000:1.0:1789264102.488935:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322685824 00000100:00100000:1.0:1789264102.488963:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789264102.488969:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:8397:x1876179322685824:12345-0@lo:503: 00000100:00100000:3.0:1789264102.489398:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685824:0@lo:503: 00000100:00100000:1.0:1789264102.489398:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:8397:x1876179322685824:12345-0@lo:503: Request processed in 429us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264102.489415:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000040:00080000:3.0:1789264102.489624:0:8397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789264102.489698:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685952:0@lo:502: 00000100:00100000:3.0:1789264102.489734:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264102.490175:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789264102.490192:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322685952 00000100:00100000:1.0:1789264102.490197:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322685952 00000100:00100000:1.0:1789264102.490242:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789264102.490251:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:8397:x1876179322685952:12345-0@lo:502: 00000100:00100000:1.0:1789264102.490323:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:8397:x1876179322685952:12345-0@lo:502: Request processed in 73us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264102.490330:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789264102.490428:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322685952:0@lo:502: 00000040:00080000:3.0:1789264102.490564:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789264102.490588:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789264102.490606:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322686080:0@lo:502: 00000100:00100000:3.0:1789264102.490681:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264102.490696:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789264102.490727:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322686080 00000100:00100000:1.0:1789264102.490730:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322686080 00000100:00100000:0.0:1789264102.490809:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789264102.490820:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:8397:x1876179322686080:12345-0@lo:502: 00000100:00100000:0.0:1789264102.490909:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:8397:x1876179322686080:12345-0@lo:502: Request processed in 91us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.490923:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789264102.490927:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322686080:0@lo:502: 00000040:00080000:3.0:1789264102.490964:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789264102.490972:0:8397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789264102.491399:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789264102.491408:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264102.491410:0:8425:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789264102.491417:0:8425:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c3aba913000 00000020:00000080:0.0:1789264102.491420:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789264102.491431:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264102.491433:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264102.491435:0:8425:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789264102.491437:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789264102.491492:0:8397:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789264102.491515:0:8397:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789264102.491538:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6977 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.491549:0:8397:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6977 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264102.491615:0:8397:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789264102.491618:0:8397:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c3aba913000 10000000:01000000:3.0:1789264102.491621:0:8397:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c3aba913000 10000000:01000000:3.0:1789264102.491626:0:8397:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789264102.491631:0:8397:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3aba913000 from 1 10000000:01000000:3.0:1789264102.491633:0:8397:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789264102.491656:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.491664:0:8397:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.491673:0:8397:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264102.491686:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322686208:0@lo:101: 00000100:00100000:3.0:1789264102.491715:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264102.491761:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322686208 00000100:00100000:0.0:1789264102.491765:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322686208 00000100:00100000:0.0:1789264102.492044:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789264102.492053:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:8397:x1876179322686208:12345-0@lo:101: 00010000:00010000:0.0:1789264102.492062:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264102.492073:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a80030200/0xecaf9f2f14ed6985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed697e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.492091:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a80030200/0xecaf9f2f14ed6985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed697e expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.492102:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a80030200/0xecaf9f2f14ed6985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed697e expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.492110:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a80030200, rc 0) 00000100:00100000:3.0:1789264102.492113:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789264102.492150:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8397:x1876179322686208:12345-0@lo:101: Request processed in 99us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.492154:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789264102.492226:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322686208:0@lo:101: 00010000:00010000:3.0:1789264102.492238:0:8397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6985 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.492248:0:8397:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6985 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264102.492310:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322686336:0@lo:501: 00000100:00100000:3.0:1789264102.492335:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264102.492374:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789264102.492387:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322686336 00000100:00100000:0.0:1789264102.492399:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322686336 00000100:00100000:0.0:1789264102.492464:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789264102.492473:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8397:x1876179322686336:12345-0@lo:501: 00000100:00100000:0.0:1789264102.492555:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8397:x1876179322686336:12345-0@lo:501: Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.492563:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789264102.492580:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322686336:0@lo:501: 00000100:00100000:3.0:1789264102.492616:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322686464:0@lo:503: 00000100:00100000:3.0:1789264102.492651:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264102.492669:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789264102.492671:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322686464 00000100:00100000:0.0:1789264102.492676:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322686464 00000100:00100000:0.0:1789264102.492706:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789264102.492714:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8397:x1876179322686464:12345-0@lo:503: 00000100:00100000:0.0:1789264102.492843:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8397:x1876179322686464:12345-0@lo:503: Request processed in 130us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.492851:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789264102.492863:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322686464:0@lo:503: 00000040:00080000:3.0:1789264102.493177:0:8397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789264102.493237:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322686592:0@lo:502: 00000100:00100000:3.0:1789264102.493267:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264102.493296:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789264102.493346:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322686592 00000100:00100000:0.0:1789264102.493360:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322686592 00000100:00100000:0.0:1789264102.493385:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789264102.493391:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8397:x1876179322686592:12345-0@lo:502: 00000100:00100000:0.0:1789264102.493508:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8397:x1876179322686592:12345-0@lo:502: Request processed in 116us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.493515:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789264102.493571:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322686592:0@lo:502: 00000040:00080000:3.0:1789264102.493937:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789264102.493972:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789264102.493986:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789264102.493998:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789264102.494263:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789264102.494282:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789264102.494296:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789264102.494310:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789264102.494324:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789264102.494338:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789264102.494363:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789264102.494380:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789264102.494394:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789264102.494409:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789264102.494424:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789264102.494438:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789264102.494453:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789264102.494467:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789264102.494492:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789264102.494506:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789264102.494530:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789264102.494545:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789264102.494559:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789264102.494573:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789264102.494587:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789264102.494601:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789264102.494615:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789264102.494629:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789264102.494643:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789264102.494657:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789264102.494669:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789264102.494681:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789264102.494695:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789264102.494707:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789264102.494720:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789264102.494734:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789264102.494788:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1789264102.494818:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322686720:0@lo:502: 00000100:00100000:3.0:1789264102.494865:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264102.494901:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789264102.494996:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322686720 00000100:00100000:0.0:1789264102.495002:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322686720 00000100:00100000:0.0:1789264102.495052:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789264102.495061:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8397:x1876179322686720:12345-0@lo:502: 00000100:00100000:0.0:1789264102.495176:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8397:x1876179322686720:12345-0@lo:502: Request processed in 115us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.495191:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789264102.495334:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322686720:0@lo:502: 00000040:00080000:3.0:1789264102.495385:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789264102.495393:0:8397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789264102.495764:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789264102.495786:0:8426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c3982363370) 00000020:00000080:0.0:1789264102.495808:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789264102.495898:0:8426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3aba913000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789264102.495902:0:8426:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c3aba913000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789264102.495905:0:8426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3aba913000 3 00010000:00080000:0.0:1789264102.495941:0:8426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3982013800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.144@tcp at head 00010000:00010000:0.0:1789264102.498563:0:8426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1789264102.498799:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789264102.498831:0:8426:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789264102.498842:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xecaf9f2f14ed6993 00000100:00080000:0.0:1789264102.498850:0:8426:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789264102.498855:0:8426:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c3982013800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264102.498884:0:8426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3aa98a1c00 x1876179322686848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789264102.498904:0:8426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789264102.499135:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322686976:0@lo:400: 00000100:00100000:1.0:1789264102.499152:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1876179322686848:0@lo:38: 00000100:00100000:0.0:1789264102.499203:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264102.499238:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322686976 00000100:00100000:1.0:1789264102.499245:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322686976 00000100:00100000:0.0:1789264102.499251:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789264102.499258:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322687104:0@lo:400: 00000100:00100000:1.0:1789264102.499287:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789264102.499298:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264102.499314:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322686976:12345-0@lo:400: 00000100:00100000:0.0:1789264102.499333:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322687232:0@lo:400: 00000100:00100000:0.0:1789264102.499380:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264102.499391:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322686976:12345-0@lo:400: Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264102.499400:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789264102.499418:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322687104 00000100:00100000:1.0:1789264102.499422:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322687104 00000100:00100000:0.0:1789264102.499431:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322687232 00000100:00100000:0.0:1789264102.499437:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322687232 00000100:00100000:1.0:1789264102.499454:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789264102.499463:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322687104:12345-0@lo:400: 00000100:00100000:0.0:1789264102.499477:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789264102.499487:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322687232:12345-0@lo:400: 00000100:00100000:1.0:1789264102.499502:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322687104:12345-0@lo:400: Request processed in 40us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264102.499510:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264102.499538:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322687232:12345-0@lo:400: Request processed in 52us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264102.499551:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789264102.499575:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264102.499629:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322687232:0@lo:400: 00010000:00080000:0.0:1789264102.499655:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c3ab301fb80 x1876179322687104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264102.499663:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322687104:0@lo:400: 00010000:00080000:0.0:1789264102.499672:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c3ab301d500 x1876179322686976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264102.499679:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322686976:0@lo:400: 00000100:00100000:1.0:1789264102.499779:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322686848 00000100:00100000:1.0:1789264102.499785:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322686848 00000100:00100000:1.0:1789264102.500004:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789264102.500010:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1876179322686848:12345-0@lo:38: 00010000:00080000:1.0:1789264102.500029:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:1.0:1789264102.500065:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xecaf9f2f14ed699a 00000020:01000004:0.0:1789264102.500067:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000004:00100000:1.0:1789264102.500080:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:0.0:1789264102.500081:0:8426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c39823619b8) 00000020:00000080:0.0:1789264102.500099:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00080000:1.0:1789264102.500118:0:6492:0:(import.c:65:import_set_state_nolock()) ffff9c39820dd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789264102.500165:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876179322686848:12345-0@lo:38: Request processed in 154us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264102.500172:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1789264102.500172:0:8426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3aba913000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789264102.500180:0:8426:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c3aba913000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789264102.500184:0:8426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3aba913000 3 00010000:00080000:0.0:1789264102.500219:0:8426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3982010000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.144@tcp at head 00010000:00010000:0.0:1789264102.502236:0:8426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1789264102.502488:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789264102.502524:0:8426:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789264102.502536:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xecaf9f2f14ed69a8 00000100:00080000:0.0:1789264102.502546:0:8426:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789264102.502551:0:8426:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c3982010000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264102.502583:0:8426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3aa98a3100 x1876179322687360/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789264102.502596:0:8426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789264102.502662:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3621:1876179322687360:0@lo:38: 00000100:00100000:0.0:1789264102.502724:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264102.502790:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322687360 00000100:00100000:1.0:1789264102.502798:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322687360 00000100:00100000:1.0:1789264102.502840:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789264102.502849:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1876179322687360:12345-0@lo:38: 00010000:00080000:1.0:1789264102.502872:0:6490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00010000:00080000:0.0:1789264102.502906:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c3aa98a1c00 x1876179322686848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789264112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264102.502917:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000020:00000080:1.0:1789264102.502922:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xecaf9f2f14ed69af 00000100:00080000:0.0:1789264102.502925:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000004:00100000:1.0:1789264102.502938:0:6490:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789264102.502942:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789264102.502948:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789264102.502951:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3982013800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789264102.502958:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1876179322686848:0@lo:38: 00000100:00080000:1.0:1789264102.502970:0:6490:0:(import.c:65:import_set_state_nolock()) ffff9c39820d9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789264102.503039:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876179322687360:12345-0@lo:38: Request processed in 190us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264102.503046:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789264102.503092:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c3aa98a3100 x1876179322687360/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789264112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264102.503101:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789264102.503105:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789264102.503113:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789264102.503117:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789264102.503118:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3982010000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789264102.503131:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3621:1876179322687360:0@lo:38: 00000040:00080000:0.0:1789264102.503223:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1789264102.503837:0:8397:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789264102.503870:0:8397:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789264102.503892:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6985 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264102.503903:0:8397:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6985 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789264102.503976:0:8397:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789264102.503979:0:8397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789264102.503980:0:8397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264102.503981:0:8397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789264102.503983:0:8397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264102.503984:0:8397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264102.503985:0:8397:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789264102.503987:0:8397:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789264102.503988:0:8397:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789264102.503989:0:8397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264102.503990:0:8397:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789264102.503994:0:8397:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789264102.503996:0:8397:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789264102.503998:0:8397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789264102.503998:0:8397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264102.503999:0:8397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789264102.504000:0:8397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264102.504001:0:8397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264102.504002:0:8397:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789264102.504003:0:8397:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789264102.504004:0:8397:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789264102.504005:0:8397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264102.504006:0:8397:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789264102.504035:0:8397:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789264102.504050:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322687488:0@lo:253: 00000100:00100000:0.0:1789264102.504096:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264102.504142:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322687488 00000100:00100000:0.0:1789264102.504147:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322687488 00000100:00100000:0.0:1789264102.504202:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789264102.504211:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8397:x1876179322687488:12345-0@lo:253: 20000000:01000000:0.0:1789264102.504233:0:6485:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789264102.504245:0:6485:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789264102.504373:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a3079c0 going to sleep for 11 seconds 20000000:01000000:2.0:1789264102.514238:0:6485:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789264102.514259:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789264102.514320:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789264102.514326:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789264102.514347:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.514375:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed68b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68ac expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.514400:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8f095800/0xecaf9f2f14ed68dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68d6 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.514408:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.514444:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8f095800/0xecaf9f2f14ed68dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed68d6 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.514456:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8f095800/0xecaf9f2f14ed68dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68d6 expref: 16 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264102.514470:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876179322687616:0@lo:104: 00000100:00100000:3.0:1789264102.514534:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789264102.514647:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed68b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed68ac expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264102.514695:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:8397:x1876179322687488:12345-0@lo:253: Request processed in 10483us (10595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264102.514706:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789264102.514826:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8397:1876179322687488:0@lo:253: 10000000:01000000:1.0:1789264102.514839:0:8397:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789264102.514842:0:8397:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789264102.514844:0:8397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789264102.514845:0:8397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789264102.514846:0:8397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789264102.514847:0:8397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789264102.514848:0:8397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789264102.514850:0:8397:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789264102.514851:0:8397:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789264102.514853:0:8397:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789264102.514854:0:8397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789264102.514855:0:8397:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789264102.514868:0:8397:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789264102.515024:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed68b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68ac expref: 16 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264102.515033:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f34ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876179322687744:0@lo:104: 00000100:00100000:3.0:1789264102.515058:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8ea6ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264102.515339:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789264102.515381:0:6474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264102.515450:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322687616 00000100:00100000:0.0:1789264102.515457:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322687616 00000100:00100000:3.0:1789264102.515514:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322687744 00000100:00100000:3.0:1789264102.515518:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322687744 00000100:00100000:3.0:1789264102.515538:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789264102.515546:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab7f41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:6506:x1876179322687616:12345-0@lo:104: 00010000:00010000:3.0:1789264102.515558:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed68dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.515628:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789264102.515634:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab7f41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:6506:x1876179322687616:12345-0@lo:104: Request processed in 89us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264102.515641:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789264102.515672:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789264102.515679:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:6506:x1876179322687744:12345-0@lo:104: 00010000:00010000:3.0:1789264102.515687:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed68ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed68b3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.515719:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789264102.515725:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:6506:x1876179322687744:12345-0@lo:104: Request processed in 47us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264102.515731:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789264102.515787:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789264102.515789:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876179322687616:0@lo:104: 00010000:00010000:3.0:1789264102.515793:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed68dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.515803:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a80031000 already unused, calling callback (ffffffffc148ec20) 00000100:00100000:2.0:1789264102.515803:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f34ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876179322687744:0@lo:104: 10000000:00010000:3.0:1789264102.515809:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed68dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.515819:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed68dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.515826:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789264102.515827:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed68dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264102.515847:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789264102.515882:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.515888:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789264102.515916:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.515924:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed68d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.515948:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264102.515951:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed68ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed68b3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.515956:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1789264102.515959:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed68ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed68b3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.515964:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed68ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed68b3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789264102.515969:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed68ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed68b3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264102.515974:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789264102.515989:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed68ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68b3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.515994:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789264102.516006:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed68ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68b3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516022:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed68ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68b3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516035:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264102.516037:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264102.516039:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264102.516215:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322687872:0@lo:103: 00000100:00100000:2.0:1789264102.516251:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264102.516294:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789264102.516303:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322688000:0@lo:103: 00000100:00100000:3.0:1789264102.516460:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322687872 00000100:00100000:3.0:1789264102.516466:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322687872 00010000:00010000:3.0:1789264102.516485:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8f095800/0xecaf9f2f14ed68dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68d6 expref: 16 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264102.516514:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789264102.516521:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:3623:x1876179322687872:12345-0@lo:103: 00010000:00010000:3.0:1789264102.516531:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264102.516536:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8f095800/0xecaf9f2f14ed68dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68d6 expref: 16 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516546:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8f095800/0xecaf9f2f14ed68dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68d6 expref: 16 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516559:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f095800/0xecaf9f2f14ed68dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed68d6 expref: 16 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516570:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264102.516603:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264102.516609:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264102.516687:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:3623:x1876179322687872:12345-0@lo:103: Request processed in 165us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264102.516694:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789264102.516707:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322688000 00000100:00100000:3.0:1789264102.516717:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322688000 00010000:00010000:3.0:1789264102.516730:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed68b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68ac expref: 15 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264102.516768:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789264102.516774:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:3625:x1876179322688000:12345-0@lo:103: 00010000:00010000:3.0:1789264102.516781:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264102.516785:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed68b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68ac expref: 15 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516793:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed68b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68ac expref: 15 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516802:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed68b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed68ac expref: 15 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516813:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516820:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789264102.516831:0:6476:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003560844s 00010000:00010000:3.0:1789264102.516836:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516842:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516848:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516865:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516870:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b600 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264102.516874:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516880:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516893:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264102.516901:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264102.516939:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:3625:x1876179322688000:12345-0@lo:103: Request processed in 152us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264102.516946:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789264102.517192:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322688000:0@lo:103: 00000100:00100000:2.0:1789264102.517231:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322687872:0@lo:103: 00010000:00010000:2.0:1789264102.517248:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.517269:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264102.517275:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69b6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1789264102.523596:0:8397:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789264102.523895:0:8397:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789264102.524045:0:8397:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789264102.524142:0:8397:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789264102.524319:0:8397:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789264102.524608:0:8397:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789264102.525336:0:8397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789264102.532640:0:8397:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789264102.532649:0:8397:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789264102.532681:0:8397:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789264102.532719:0:8397:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789264102.532737:0:8397:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789264102.532894:0:8397:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789264102.533604:0:8397:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789264102.533829:0:8397:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789264103.049872:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789264103.052447:0:8482:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789264103.052685:0:8482:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789264104.074065:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264104.971229:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789264104.971251:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322688128:0@lo:41: 00000100:00100000:0.0:1789264104.971313:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264104.971384:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322688128 00000100:00100000:0.0:1789264104.971391:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322688128 00000100:00100000:0.0:1789264104.971439:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789264104.971448:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322688128:12345-0@lo:41: 00000004:00000024:0.0:1789264104.971478:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789264104.971522:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322688128:12345-0@lo:41: Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264104.971528:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789264104.971572:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322688128:0@lo:41: 00010000:00010000:2.0:1789264105.098895:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264106.123360:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789264106.139997:0:8772:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1789264106.722195:0:8824:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789264106.722407:0:8824:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789264107.017844:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789264107.017852:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3aae2b1800 from 30 10000000:01000000:2.0:1789264107.017857:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789264107.017898:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.017910:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.017922:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264107.017945:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322688256:0@lo:101: 00000100:00100000:2.0:1789264107.018013:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.018135:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab6805300 going to sleep for 11 seconds 00000100:00100000:3.0:1789264107.018239:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322688256 00000100:00100000:3.0:1789264107.018247:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322688256 00000100:00100000:3.0:1789264107.018341:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789264107.018352:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:6487:x1876179322688256:12345-0@lo:101: 00010000:00010000:3.0:1789264107.018364:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264107.018377:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed69bd expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264107.018411:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed69bd expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264107.018422:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed69bd expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264107.018431:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b600, rc 0) 00000100:00100000:3.0:1789264107.018479:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:6487:x1876179322688256:12345-0@lo:101: Request processed in 130us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264107.018484:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789264107.018559:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322688256:0@lo:101: 00010000:00010000:2.0:1789264107.018572:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed69c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.018581:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed69c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264107.018659:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322688384:0@lo:501: 00000100:00100000:2.0:1789264107.018690:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.018980:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab6805300 going to sleep for 11 seconds 00000100:00100000:1.0:1789264107.019027:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322688384 00000100:00100000:1.0:1789264107.019032:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322688384 00000100:00100000:1.0:1789264107.019056:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789264107.019063:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:6487:x1876179322688384:12345-0@lo:501: 00000100:00100000:1.0:1789264107.019193:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:6487:x1876179322688384:12345-0@lo:501: Request processed in 130us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264107.019201:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789264107.019396:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322688384:0@lo:501: 00000100:00100000:2.0:1789264107.019424:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322688512:0@lo:503: 00000100:00100000:2.0:1789264107.019467:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.019530:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab6805300 going to sleep for 11 seconds 00000100:00100000:1.0:1789264107.019573:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322688512 00000100:00100000:1.0:1789264107.019578:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322688512 00000100:00100000:1.0:1789264107.019703:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789264107.019712:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:6487:x1876179322688512:12345-0@lo:503: 00000100:00100000:1.0:1789264107.019837:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:6487:x1876179322688512:12345-0@lo:503: Request processed in 125us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264107.019844:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789264107.020033:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322688512:0@lo:503: 00000100:00100000:2.0:1789264107.020432:0:8846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8846:1876179322688640:0@lo:502: 00000100:00100000:2.0:1789264107.020469:0:8846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.020535:0:8846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab6805300 going to sleep for 11 seconds 00000100:00100000:3.0:1789264107.020577:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322688640 00000100:00100000:3.0:1789264107.020582:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322688640 00000100:00100000:2.0:1789264107.020872:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789264107.020881:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:8846:x1876179322688640:12345-0@lo:502: 00000100:00100000:2.0:1789264107.020991:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:8846:x1876179322688640:12345-0@lo:502: Request processed in 111us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.020997:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789264107.021074:0:8846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8846:1876179322688640:0@lo:502: 00000100:00100000:3.0:1789264107.021122:0:8846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8846:1876179322688768:0@lo:502: 00000100:00100000:3.0:1789264107.021166:0:8846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.024068:0:8846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5900 going to sleep for 11 seconds 00000100:00100000:1.0:1789264107.024253:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322688768 00000100:00100000:1.0:1789264107.024263:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322688768 00000100:00100000:1.0:1789264107.024312:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789264107.024335:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:8846:x1876179322688768:12345-0@lo:502: 00000100:00100000:2.0:1789264107.024731:0:8846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8846:1876179322688768:0@lo:502: 00000040:00080000:2.0:1789264107.024783:0:8846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:1.0:1789264107.024890:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:8846:x1876179322688768:12345-0@lo:502: Request processed in 568us (3722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264107.024899:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000020:01000000:3.0:1789264107.025170:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789264107.025192:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789264107.025202:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed69c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264107.025213:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed69c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264107.025222:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789264107.025224:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c3aae2b1800 from 5 10000000:01000000:3.0:1789264107.025227:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789264107.025262:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264107.025270:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264107.025280:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264107.025296:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322688896:0@lo:101: 00000100:00100000:3.0:1789264107.025345:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.025468:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789264107.025500:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322688896 00000100:00100000:2.0:1789264107.025505:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322688896 00000100:00100000:2.0:1789264107.025692:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789264107.025706:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:6487:x1876179322688896:12345-0@lo:101: 00010000:00010000:2.0:1789264107.025717:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264107.025736:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed69d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed69cb expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.025779:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed69d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed69cb expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.025790:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed69d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed69cb expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.025909:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622e00, rc 0) 00000100:00100000:2.0:1789264107.025982:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322688896:12345-0@lo:101: Request processed in 283us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.025989:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789264107.026041:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322688896:0@lo:101: 00010000:00010000:3.0:1789264107.026053:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed69d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264107.026062:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed69d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264107.026169:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322689024:0@lo:256: 00000100:00100000:3.0:1789264107.026196:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.026262:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789264107.026287:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322689024 00000100:00100000:1.0:1789264107.026291:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322689024 00000100:00100000:1.0:1789264107.026346:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789264107.026353:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322689024:12345-0@lo:256: 20000000:01000000:1.0:1789264107.026365:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789264107.026390:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789264107.026393:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789264107.026475:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322689024:12345-0@lo:256: Request processed in 122us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264107.026482:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789264107.026538:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322689024:0@lo:256: 10000000:01000000:2.0:1789264107.026583:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789264107.026589:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed69d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.026596:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed69d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264107.026603:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789264107.026605:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1789264107.026608:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789264107.026625:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.026632:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.026649:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264107.026660:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322689152:0@lo:101: 00000100:00100000:2.0:1789264107.026686:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.027044:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab6805f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789264107.027094:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322689152 00000100:00100000:3.0:1789264107.027100:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322689152 00000100:00100000:3.0:1789264107.027125:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789264107.027133:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322689152:12345-0@lo:101: 00010000:00010000:3.0:1789264107.027141:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264107.027152:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed69e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed69d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264107.027178:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed69e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed69d9 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264107.027186:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed69e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed69d9 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264107.027195:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36ac00, rc 0) 00000100:00100000:3.0:1789264107.027225:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322689152:12345-0@lo:101: Request processed in 94us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264107.027231:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789264107.027467:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322689152:0@lo:101: 00010000:00010000:2.0:1789264107.027479:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed69e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.027486:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed69e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264107.027537:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322689280:0@lo:501: 00000100:00100000:2.0:1789264107.027628:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.027680:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab6805f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789264107.027726:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322689280 00000100:00100000:3.0:1789264107.027730:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322689280 00000100:00100000:2.0:1789264107.028345:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789264107.028356:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322689280:12345-0@lo:501: 00000100:00100000:2.0:1789264107.028545:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322689280:12345-0@lo:501: Request processed in 191us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.028552:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789264107.028739:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322689280:0@lo:501: 00000100:00100000:3.0:1789264107.028818:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f34a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322689408:0@lo:503: 00000100:00100000:3.0:1789264107.028865:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.029042:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264107.029074:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322689408 00000100:00100000:1.0:1789264107.029157:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322689408 00000100:00100000:1.0:1789264107.029186:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789264107.029194:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322689408:12345-0@lo:503: 00000100:00100000:1.0:1789264107.029331:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322689408:12345-0@lo:503: Request processed in 137us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264107.029338:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789264107.029702:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f34a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322689408:0@lo:503: 00000100:00100000:1.0:1789264107.030245:0:8848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8848:1876179322689536:0@lo:502: 00000100:00100000:1.0:1789264107.030290:0:8848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264107.030358:0:8848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a82fd3480 going to sleep for 11 seconds 00000100:00100000:2.0:1789264107.030455:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322689536 00000100:00100000:2.0:1789264107.030460:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322689536 00000100:00100000:2.0:1789264107.030494:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789264107.030502:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:8848:x1876179322689536:12345-0@lo:502: 00000100:00100000:2.0:1789264107.030628:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:8848:x1876179322689536:12345-0@lo:502: Request processed in 127us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.030640:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789264107.030720:0:8848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8848:1876179322689536:0@lo:502: 00000020:01000000:1.0:1789264107.030886:0:8848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789264107.030894:0:8848:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789264107.030902:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264107.030904:0:8848:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789264107.030909:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789264107.030913:0:8848:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:1.0:1789264107.030933:0:8848:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789264107.030936:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789264107.030948:0:8848:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c3ab6813370) 00000020:00000080:1.0:1789264107.030968:0:8848:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1789264107.030973:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789264107.031051:0:8848:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789264107.031057:0:8848:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789264107.031063:0:8848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xecaf9f2f14ed69ee 00010000:00080000:1.0:1789264107.031155:0:8848:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3ababd8000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:1.0:1789264107.031616:0:8848:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789264107.042069:0:8848:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789264107.042093:0:8848:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789264107.042356:0:8848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789264107.042671:0:8848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789264107.042803:0:8848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789264107.042923:0:8848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789264107.045106:0:8850:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789264107.045113:0:8850:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789264107.048235:0:8848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789264107.048250:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789264107.048310:0:8848:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789264107.048344:0:8848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xecaf9f2f14ed69f5 00000100:00080000:0.0:1789264107.048355:0:8848:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789264107.048360:0:8848:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c3ababd8000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264107.048394:0:8848:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3aa98a0a80 x1876179322689664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789264107.048421:0:8848:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789264107.048486:0:8848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264107.048490:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264107.048492:0:8848:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789264107.048495:0:8848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:2.0:1789264107.048594:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322689664:0@lo:8: 00000100:00100000:2.0:1789264107.048665:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.048927:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322689920:0@lo:400: 00000100:00100000:2.0:1789264107.048955:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.048974:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1876179322690432:0@lo:400: 00000100:00100000:2.0:1789264107.048999:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.049016:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789264107.049021:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322689792:0@lo:400: 00000100:00100000:2.0:1789264107.049042:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.049059:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322690304:0@lo:400: 00000100:00100000:1.0:1789264107.049069:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322690176:0@lo:400: 00000100:00100000:2.0:1789264107.049086:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264107.049115:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.049120:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322690048:0@lo:400: 00000100:00100000:1.0:1789264107.049156:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322690432 00000100:00100000:2.0:1789264107.049167:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.049202:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322689792 00000100:00100000:2.0:1789264107.049208:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322689792 00000100:00100000:2.0:1789264107.049241:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322690304 00000100:00100000:2.0:1789264107.049244:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322690304 00000100:00100000:2.0:1789264107.049265:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322690048 00000100:00100000:2.0:1789264107.049268:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322690048 00000100:00100000:2.0:1789264107.049283:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789264107.049291:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322689792:12345-0@lo:400: 00000100:00100000:2.0:1789264107.049359:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322689792:12345-0@lo:400: Request processed in 68us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.049366:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789264107.049382:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789264107.049390:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322690304:12345-0@lo:400: 00000100:00100000:2.0:1789264107.049416:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322690304:12345-0@lo:400: Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.049422:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789264107.049434:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789264107.049441:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322690048:12345-0@lo:400: 00000100:00100000:2.0:1789264107.049471:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322690048:12345-0@lo:400: Request processed in 32us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.049477:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789264107.049521:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3ab301f800 x1876179322690048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264107.049535:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322690048:0@lo:400: 00010000:00080000:2.0:1789264107.049563:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3ab301d500 x1876179322689792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264107.049573:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322689792:0@lo:400: 00010000:00080000:2.0:1789264107.049582:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3ab301c380 x1876179322690304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264107.049590:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322690304:0@lo:400: 00000100:00100000:1.0:1789264107.049847:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322690432 00000100:00100000:1.0:1789264107.049884:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789264107.049892:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1876179322690432:12345-0@lo:400: 00000100:00100000:1.0:1789264107.050010:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1876179322690432:12345-0@lo:400: Request processed in 120us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264107.050017:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789264107.050038:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322689920 00000100:00100000:1.0:1789264107.050042:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322689920 00000100:00100000:1.0:1789264107.050066:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322690176 00000100:00100000:1.0:1789264107.050069:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322690176 00000100:00100000:1.0:1789264107.050084:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789264107.050091:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322689920:12345-0@lo:400: 00000100:00100000:1.0:1789264107.050126:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322689920:12345-0@lo:400: Request processed in 36us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264107.050133:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789264107.050145:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789264107.050152:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322690176:12345-0@lo:400: 00000100:00100000:3.0:1789264107.050159:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322689664 00000100:00100000:3.0:1789264107.050166:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322689664 00000100:00100000:3.0:1789264107.050191:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789264107.050196:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3621:x1876179322689664:12345-0@lo:8: 00010000:00080000:3.0:1789264107.050220:0:8403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:3.0:1789264107.050245:0:8403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xecaf9f2f14ed69fc 00002000:00100000:3.0:1789264107.050274:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c3982344800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789264107.050278:0:8403:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1789264107.050288:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789264107.050357:0:8403:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789264107.050627:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789264107.050870:0:8403:0:(import.c:65:import_set_state_nolock()) ffff9c3982346000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789264107.050924:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3621:x1876179322689664:12345-0@lo:8: Request processed in 726us (2260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264107.050931:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789264107.050986:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3aa98a0a80 x1876179322689664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789264117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264107.050995:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789264107.051002:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789264107.051009:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789264107.051014:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789264107.051017:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3ababd8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789264107.051033:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789264107.051038:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322689664:0@lo:8: 00000100:00100000:3.0:1789264107.051084:0:8851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f34a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1876179322690560:0@lo:700: 00000100:00100000:3.0:1789264107.051127:0:8851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264107.051136:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322690176:12345-0@lo:400: Request processed in 982us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264107.051145:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789264107.051150:0:8851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264107.051287:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322689920:0@lo:400: 00010000:00080000:1.0:1789264107.051304:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3ab301e680 x1876179322690432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264107.051314:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1876179322690432:0@lo:400: 00000100:00080000:0.0:1789264107.051423:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789264107.051429:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264107.051448:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322690176:0@lo:400: 00000100:00100000:0.0:1789264107.051451:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322690560 00000100:00100000:0.0:1789264107.051458:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322690560 00000100:00100000:0.0:1789264107.051507:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789264107.051516:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8851:x1876179322690560:12345-0@lo:700: 00000100:00080000:1.0:1789264107.051526:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789264107.052203:0:8850:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789264107.052270:0:8850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 187393525610ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789264107.052277:0:8850:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:00000080:1.0:1789264107.052301:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264107.052305:0:8848:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789264107.052314:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000100:00100000:0.0:1789264107.053485:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8412:1876179322690688:0@lo:700: 00000100:00100000:0.0:1789264107.053554:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264107.053589:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264107.053624:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322690688 00000100:00100000:0.0:1789264107.053630:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322690688 00000100:00100000:0.0:1789264107.053678:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789264107.053686:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8412:x1876179322690688:12345-0@lo:700: 00000020:00000080:1.0:1789264107.053706:0:8848:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789264107.053871:0:8848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8848:1876179322690816:0@lo:502: 00000100:00100000:1.0:1789264107.053916:0:8848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.053944:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322690816 00000100:00100000:1.0:1789264107.053948:0:8848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a82fd3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789264107.053950:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322690816 00000100:00100000:2.0:1789264107.053997:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789264107.054005:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:8848:x1876179322690816:12345-0@lo:502: 00000100:00100000:2.0:1789264107.054109:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:8848:x1876179322690816:12345-0@lo:502: Request processed in 106us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.054116:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789264107.054167:0:8848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8848:1876179322690816:0@lo:502: 00000020:01000000:2.0:1789264107.054195:0:8848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264107.054201:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264107.054203:0:8848:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789264107.054206:0:8848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1789264107.054375:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1789264107.054396:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789264107.054406:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed69e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264107.054416:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed69e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264107.054426:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789264107.054434:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3a89eb9800 from 30 10000000:01000000:3.0:1789264107.054437:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789264107.054459:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264107.054467:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264107.054476:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264107.054489:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322690944:0@lo:101: 00000100:00100000:3.0:1789264107.054603:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.054658:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5300 going to sleep for 11 seconds 00000100:00100000:2.0:1789264107.054691:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322690944 00000100:00100000:2.0:1789264107.054695:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322690944 00000100:00100000:2.0:1789264107.055063:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789264107.055073:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322690944:12345-0@lo:101: 00010000:00010000:2.0:1789264107.055083:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264107.055095:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6a0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6a03 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.055116:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a03 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.055127:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a03 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.055135:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623400, rc 0) 00000100:00100000:2.0:1789264107.055169:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322690944:12345-0@lo:101: Request processed in 99us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.055175:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789264107.055400:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322690944:0@lo:101: 00010000:00010000:3.0:1789264107.055413:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a0a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264107.055422:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6a0a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264107.055472:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322691072:0@lo:501: 00000100:00100000:3.0:1789264107.055510:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.055705:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789264107.055767:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322691072 00000100:00100000:0.0:1789264107.055772:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322691072 00000100:00100000:0.0:1789264107.055797:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789264107.055804:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322691072:12345-0@lo:501: 00000100:00100000:0.0:1789264107.055922:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322691072:12345-0@lo:501: Request processed in 118us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264107.055928:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789264107.056076:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322691072:0@lo:501: 00000100:00100000:3.0:1789264107.056103:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322691200:0@lo:503: 00000100:00100000:3.0:1789264107.056139:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.056162:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789264107.056247:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322691200 00000100:00100000:0.0:1789264107.056252:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322691200 00000100:00100000:0.0:1789264107.056270:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789264107.056275:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322691200:12345-0@lo:503: 00000100:00100000:0.0:1789264107.056360:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322691200:12345-0@lo:503: Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264107.056367:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789264107.056607:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322691200:0@lo:503: 00000004:00080000:2.0:1789264107.056977:0:7421:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789264107.057157:0:8853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8853:1876179322691328:0@lo:502: 00000100:00100000:3.0:1789264107.057192:0:8853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.057222:0:8853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789264107.057260:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322691328 00000100:00100000:2.0:1789264107.057265:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322691328 00000100:00100000:2.0:1789264107.057300:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789264107.057308:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:8853:x1876179322691328:12345-0@lo:502: 00000100:00100000:2.0:1789264107.057400:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:8853:x1876179322691328:12345-0@lo:502: Request processed in 93us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.057406:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789264107.057445:0:8853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8853:1876179322691328:0@lo:502: 00000100:00100000:2.0:1789264107.057486:0:8853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8853:1876179322691456:0@lo:502: 00000100:00100000:2.0:1789264107.057595:0:8853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.057613:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322691456 00000100:00100000:2.0:1789264107.057617:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322691456 00000100:00100000:2.0:1789264107.057638:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789264107.057644:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:8853:x1876179322691456:12345-0@lo:502: 00000100:00100000:2.0:1789264107.057702:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:8853:x1876179322691456:12345-0@lo:502: Request processed in 57us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.057708:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789264107.057737:0:8853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c49a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789264107.057771:0:8853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8853:1876179322691456:0@lo:502: 00000040:00080000:2.0:1789264107.057790:0:8853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789264107.057834:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789264107.057849:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789264107.057857:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a0a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.057866:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a0a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264107.057885:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789264107.057887:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c3a89eb9800 from 5 10000000:01000000:2.0:1789264107.057890:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789264107.057909:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.057916:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.057924:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264107.057935:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322691584:0@lo:101: 00000100:00100000:2.0:1789264107.057959:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.057972:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c49a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789264107.058218:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322691584 00000100:00100000:2.0:1789264107.058222:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322691584 00000100:00100000:2.0:1789264107.058246:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789264107.058252:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322691584:12345-0@lo:101: 00010000:00010000:2.0:1789264107.058260:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264107.058270:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6a18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6a11 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.058288:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a11 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.058296:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a11 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.058315:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622000, rc 0) 00000100:00100000:2.0:1789264107.058357:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:6487:x1876179322691584:12345-0@lo:101: Request processed in 105us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.058363:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789264107.058395:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322691584:0@lo:101: 00010000:00010000:2.0:1789264107.058407:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a18 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.058415:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6a18 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264107.058458:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322691712:0@lo:256: 00000100:00100000:2.0:1789264107.058487:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.058610:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322691712 00000100:00100000:3.0:1789264107.058615:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322691712 00000100:00100000:3.0:1789264107.058639:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789264107.058646:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:6487:x1876179322691712:12345-0@lo:256: 20000000:01000000:3.0:1789264107.058659:0:6485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789264107.058675:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789264107.058678:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789264107.058712:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c49a900 going to sleep for 11 seconds 40000000:02000000:0.0:1789264107.060831:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1789264107.063784:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:6487:x1876179322691712:12345-0@lo:256: Request processed in 5129us (5286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264107.063799:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789264107.064647:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322691712:0@lo:256: 10000000:01000000:2.0:1789264107.064718:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789264107.064727:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a18 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.064738:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a18 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264107.064765:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789264107.064768:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789264107.064771:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789264107.064801:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.064818:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.064828:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264107.064852:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322691840:0@lo:101: 00000100:00100000:2.0:1789264107.064892:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.064929:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c49a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789264107.064944:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322691840 00000100:00100000:2.0:1789264107.064949:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322691840 00000100:00100000:2.0:1789264107.064980:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789264107.064988:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:6487:x1876179322691840:12345-0@lo:101: 00010000:00010000:2.0:1789264107.064998:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264107.065009:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6a26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6a1f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.065030:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a1f expref: 20 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.065040:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a1f expref: 20 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.065048:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623e00, rc 0) 00000100:00100000:2.0:1789264107.065072:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322691840:12345-0@lo:101: Request processed in 85us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.065084:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789264107.065114:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322691840:0@lo:101: 00010000:00010000:2.0:1789264107.065129:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.065138:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264107.065181:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322691968:0@lo:501: 00000100:00100000:2.0:1789264107.065203:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.065215:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c49a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789264107.065231:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322691968 00000100:00100000:2.0:1789264107.065234:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322691968 00000100:00100000:2.0:1789264107.065257:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789264107.065263:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322691968:12345-0@lo:501: 00000100:00100000:2.0:1789264107.065367:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322691968:12345-0@lo:501: Request processed in 104us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.065373:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789264107.065398:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322691968:0@lo:501: 00000100:00100000:2.0:1789264107.065418:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322692096:0@lo:503: 00000100:00100000:2.0:1789264107.065449:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.065460:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c49a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789264107.065469:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322692096 00000100:00100000:2.0:1789264107.065472:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322692096 00000100:00100000:2.0:1789264107.065490:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789264107.065507:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322692096:12345-0@lo:503: 00000100:00100000:2.0:1789264107.065574:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322692096:12345-0@lo:503: Request processed in 77us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.065580:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789264107.065620:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322692096:0@lo:503: 00000100:00100000:0.0:1789264107.068097:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8412:x1876179322690688:12345-0@lo:700: Request processed in 14405us (14537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264107.068109:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789264107.068157:0:8412:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3aa98a0a80 x1876179322690688/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789264123 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264107.068172:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8412:1876179322690688:0@lo:700: 40000000:02000000:0.0:1789264107.068182:0:8412:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1789264107.075155:0:8854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8854:1876179322692224:0@lo:502: 00000100:00100000:3.0:1789264107.075225:0:8854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.075293:0:8854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789264107.075349:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322692224 00000100:00100000:0.0:1789264107.075355:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322692224 00000100:00100000:0.0:1789264107.075429:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789264107.075437:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:8854:x1876179322692224:12345-0@lo:502: 00000100:00100000:0.0:1789264107.075541:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:8854:x1876179322692224:12345-0@lo:502: Request processed in 104us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264107.075549:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789264107.075648:0:8854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8854:1876179322692224:0@lo:502: 00000020:01000000:0.0:1789264107.075675:0:8854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789264107.075682:0:8854:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789264107.075689:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264107.075691:0:8854:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789264107.075697:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789264107.075701:0:8854:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:0.0:1789264107.075725:0:8854:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789264107.075729:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789264107.076070:0:8854:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c3982364d28) 00000020:00000080:0.0:1789264107.076089:0:8854:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1789264107.076095:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789264107.076159:0:8854:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789264107.076164:0:8854:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789264107.076170:0:8854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed6a34 00010000:00080000:0.0:1789264107.076194:0:8854:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3abaa51000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:0.0:1789264107.076422:0:8854:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:0.0:1789264107.089202:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789264107.089346:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8851:x1876179322690560:12345-0@lo:700: Request processed in 37826us (38214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264107.089362:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789264107.089435:0:8851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3a8f34a680 x1876179322690560/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789264123 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264107.089451:0:8851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f34a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1876179322690560:0@lo:700: 00000004:00080000:3.0:1789264107.094179:0:8851:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789264107.094214:0:8851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1876179322692480:0@lo:7: 00000100:00100000:3.0:1789264107.094278:0:8851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.094334:0:8851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264107.094349:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789264107.094362:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322692352:0@lo:13: 00000100:00100000:3.0:1789264107.094397:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.094434:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322692480 00000100:00100000:3.0:1789264107.094441:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322692480 00000100:00100000:3.0:1789264107.094483:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789264107.094492:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8851:x1876179322692480:12345-0@lo:7: 00000100:00100000:0.0:1789264107.098835:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322692352 00000100:00100000:0.0:1789264107.098850:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322692352 00000100:00100000:0.0:1789264107.098927:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789264107.098939:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1876179322692352:12345-0@lo:13: 00002000:00000024:0.0:1789264107.098972:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923828736 avail 3692306432 00000100:00100000:0.0:1789264107.099062:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1876179322692352:12345-0@lo:13: Request processed in 125us (4663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264107.099070:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789264107.099137:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3a8f34a680 x1876179322692352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264107.099158:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322692352:0@lo:13: 00000040:01000000:0.0:1789264107.101185:0:8854:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789264107.101208:0:8854:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789264107.101446:0:8854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789264107.101635:0:8854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789264107.101724:0:8854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789264107.101855:0:8854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789264107.102241:0:8856:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789264107.102245:0:8856:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789264107.103024:0:8854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789264107.103036:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789264107.103073:0:8854:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789264107.103096:0:8854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xecaf9f2f14ed6a3b 00000100:00080000:2.0:1789264107.103105:0:8854:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789264107.103112:0:8854:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c3abaa51000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1789264107.103147:0:8854:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3abab42a00 x1876179322692608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789264107.103174:0:8854:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789264107.103248:0:8854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264107.103253:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264107.103255:0:8854:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789264107.103257:0:8854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264107.103261:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264107.103263:0:8854:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789264107.103265:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789264107.103267:0:8854:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789264107.103293:0:8854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8854:1876179322692736:0@lo:502: 00000100:00100000:2.0:1789264107.103375:0:8854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.103406:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322692736 00000100:00100000:2.0:1789264107.103412:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322692736 00000100:00100000:2.0:1789264107.103454:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789264107.103464:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:8854:x1876179322692736:12345-0@lo:502: 00000100:00100000:2.0:1789264107.103561:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:8854:x1876179322692736:12345-0@lo:502: Request processed in 97us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.103569:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789264107.103612:0:8854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c49a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789264107.103639:0:8854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:8854:1876179322692736:0@lo:502: 00000020:01000000:2.0:1789264107.103665:0:8854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264107.103670:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264107.103672:0:8854:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789264107.103675:0:8854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789264107.103718:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789264107.103737:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789264107.103769:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.103779:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264107.103788:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789264107.103791:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c3aaa494d28 from 1 10000000:01000000:2.0:1789264107.103794:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789264107.103815:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.103823:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.103832:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264107.103844:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322692864:0@lo:101: 00000100:00100000:2.0:1789264107.103871:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.103887:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c49a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789264107.103900:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322692864 00000100:00100000:2.0:1789264107.103904:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322692864 00002000:00080000:3.0:1789264107.105689:0:8406:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789264107.105696:0:8406:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789264107.105782:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8851:x1876179322692480:12345-0@lo:7: Request processed in 11289us (11501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264107.105791:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789264107.105836:0:8851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3a8f349c00 x1876179322692480/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789264123 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264107.105849:0:8851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1876179322692480:0@lo:7: 00000004:00080000:3.0:1789264107.105859:0:8851:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789264107.105890:0:8851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1876179322692992:0@lo:5: 00000100:00100000:0.0:1789264107.106046:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322692608:0@lo:8: 00000100:00100000:0.0:1789264107.106082:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264107.106246:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322692608 00000100:00100000:0.0:1789264107.106252:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322692608 00000100:00100000:0.0:1789264107.106278:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264107.106284:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3621:x1876179322692608:12345-0@lo:8: 00010000:00080000:0.0:1789264107.106308:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:0.0:1789264107.106357:0:8405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xecaf9f2f14ed6a49 00002000:00100000:0.0:1789264107.106370:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c3abf5c5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789264107.106374:0:8405:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789264107.106377:0:8405:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789264107.106424:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789264107.106447:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9c3abf5c3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789264107.106491:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1876179322692608:12345-0@lo:8: Request processed in 205us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264107.106498:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789264107.106527:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3abab42a00 x1876179322692608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789264117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264107.106535:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789264107.106542:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789264107.106556:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789264107.106561:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789264107.106563:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3abaa51000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789264107.106574:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789264107.106578:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322692608:0@lo:8: 00000004:00080000:0.0:1789264107.106599:0:8856:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789264107.106642:0:8856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 187447897447ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789264107.106649:0:8856:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789264107.106730:0:8851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.106806:0:8851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264107.106827:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322692992 00000100:00100000:3.0:1789264107.106831:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322692992 00000100:00100000:2.0:1789264107.108234:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789264107.108245:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322692864:12345-0@lo:101: 00010000:00010000:2.0:1789264107.108257:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264107.108274:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5623a00/0xecaf9f2f14ed6a50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6a42 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.108298:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5623a00/0xecaf9f2f14ed6a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a42 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.108309:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5623a00/0xecaf9f2f14ed6a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a42 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.108336:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623a00, rc 0) 00000100:00100000:2.0:1789264107.108386:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322692864:12345-0@lo:101: Request processed in 144us (4514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.108393:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789264107.108672:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789264107.108684:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8851:x1876179322692992:12345-0@lo:5: 00002000:00080000:0.0:1789264107.108704:0:8405:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789264107.108763:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8851:x1876179322692992:12345-0@lo:5: Request processed in 60us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264107.108770:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789264107.110275:0:8851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3a8f349c00 x1876179322692992/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789264123 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264107.110293:0:8851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1876179322692992:0@lo:5: 00000004:00080000:3.0:1789264107.110306:0:8851:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789264107.110356:0:8851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1876179322693120:0@lo:5: 00000100:00100000:3.0:1789264107.110402:0:8851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.110419:0:8851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264107.110442:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322693120 00000100:00100000:3.0:1789264107.110448:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322693120 00000100:00100000:3.0:1789264107.110482:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789264107.110490:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8851:x1876179322693120:12345-0@lo:5: 00002000:00080000:3.0:1789264107.110519:0:8406:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789264107.110861:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322692864:0@lo:101: 00010000:00010000:2.0:1789264107.110884:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a50 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.110898:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6a50 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264107.110965:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322693248:0@lo:501: 00000100:00100000:2.0:1789264107.111001:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264107.111035:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322693248 00000100:00100000:2.0:1789264107.111039:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c49a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789264107.111040:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322693248 00000100:00100000:3.0:1789264107.111076:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789264107.111084:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322693248:12345-0@lo:501: 00000100:00100000:3.0:1789264107.111158:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322693248:12345-0@lo:501: Request processed in 75us (157us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789264107.111164:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789264107.111204:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322693248:0@lo:501: 10000000:01000000:2.0:1789264107.111233:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789264107.111244:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a50 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264107.111250:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a50 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264107.116807:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8851:x1876179322693120:12345-0@lo:5: Request processed in 6310us (6397us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789264107.116820:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789264107.116984:0:8851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3a8f349c00 x1876179322693120/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789264123 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264107.117003:0:8851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1876179322693120:0@lo:5: 00000004:00080000:0.0:1789264107.117017:0:8851:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1789264107.117054:0:8851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8851:1876179322693376:0@lo:900: 00000100:00100000:0.0:1789264107.117092:0:8851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264107.117346:0:8851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a852dce40 going to sleep for 11 seconds 00000004:00080000:2.0:1789264107.117387:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789264107.118047:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789264107.118060:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322693504:0@lo:13: 00000100:00100000:0.0:1789264107.118096:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264107.118123:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322693504 00000100:00100000:0.0:1789264107.118128:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322693504 00000100:00100000:0.0:1789264107.118170:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789264107.118183:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1876179322693504:12345-0@lo:13: 00002000:00000024:0.0:1789264107.118202:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1789264107.118244:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1876179322693504:12345-0@lo:13: Request processed in 61us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264107.118250:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789264107.118268:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789264107.118276:0:8857:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789264107.118294:0:8857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8857:1876179322693632:0@lo:7: 00000100:00100000:0.0:1789264107.118315:0:8857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264107.118338:0:8857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789264107.118357:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322693632 00000100:00100000:2.0:1789264107.118362:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322693632 00000100:00100000:2.0:1789264107.118403:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789264107.118414:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8857:x1876179322693632:12345-0@lo:7: 00000100:00100000:3.0:1789264107.120395:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322693376 00000100:00100000:3.0:1789264107.120407:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322693376 00000100:00100000:3.0:1789264107.120464:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789264107.120476:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8851:x1876179322693376:12345-0@lo:900: 00000100:00100000:3.0:1789264107.120560:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8851:x1876179322693376:12345-0@lo:900: Request processed in 87us (3467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264107.120569:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789264107.120615:0:8851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3abaa91180 x1876179322693376/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789264123 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264107.120630:0:8851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8851:1876179322693376:0@lo:900: 00010000:00080000:3.0:1789264107.120843:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3abaa90380 x1876179322693504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264107.120869:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322693504:0@lo:13: 00002000:00080000:2.0:1789264107.124534:0:8403:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789264107.124544:0:8403:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789264107.124783:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8857:x1876179322693632:12345-0@lo:7: Request processed in 6368us (6462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264107.124794:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789264107.124879:0:8857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3abaa91c00 x1876179322693632/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789264123 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264107.124894:0:8857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8857:1876179322693632:0@lo:7: 00000004:00080000:0.0:1789264107.124909:0:8857:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789264107.124944:0:8857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8857:1876179322693760:0@lo:5: 00000100:00100000:0.0:1789264107.125038:0:8857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264107.125071:0:8857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789264107.125354:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322693760 00000100:00100000:3.0:1789264107.125361:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322693760 00000100:00100000:3.0:1789264107.125411:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789264107.125421:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8857:x1876179322693760:12345-0@lo:5: 00002000:00080000:3.0:1789264107.125446:0:8406:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789264107.125449:0:8406:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1789264107.129170:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1789264107.129188:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789264107.129193:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789264107.129461:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8857:x1876179322693760:12345-0@lo:5: Request processed in 4037us (4419us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789264107.129473:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789264107.129561:0:8857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3abaa91c00 x1876179322693760/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789264123 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264107.129574:0:8857:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789264107.129580:0:8857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8857:1876179322693760:0@lo:5: 00000004:00080000:0.0:1789264107.129595:0:8857:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789264107.129637:0:8857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8857:1876179322693888:0@lo:700: 00000100:00100000:0.0:1789264107.129672:0:8857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264107.129779:0:8857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789264107.132993:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322693888 00000100:00100000:3.0:1789264107.133007:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322693888 00000100:00100000:3.0:1789264107.133076:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789264107.133086:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8857:x1876179322693888:12345-0@lo:700: 00000100:00100000:3.0:1789264107.143451:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8857:x1876179322693888:12345-0@lo:700: Request processed in 10358us (13770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264107.143464:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789264107.143624:0:8857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3abaa91c00 x1876179322693888/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789264123 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264107.143638:0:8857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8857:1876179322693888:0@lo:700: 00000004:02000040:0.0:1789264107.145543:0:8857:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1789264107.150665:0:8857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8857:1876179322694016:0@lo:5: 00000100:00100000:0.0:1789264107.150725:0:8857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264107.150987:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322694016 00000100:00100000:2.0:1789264107.150996:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322694016 00000100:00100000:2.0:1789264107.151057:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264107.151060:0:8857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789264107.151070:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8857:x1876179322694016:12345-0@lo:5: 00010000:00010000:3.0:1789264107.151117:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789264107.158905:0:8403:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789264107.158925:0:8403:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1789264107.163988:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8857:x1876179322694016:12345-0@lo:5: Request processed in 12915us (13255us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789264107.164001:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789264107.164071:0:8857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3abaa91c00 x1876179322694016/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789264123 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264107.164087:0:8857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8857:1876179322694016:0@lo:5: 00000004:00080000:0.0:1789264107.164106:0:8857:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000001:00080000:2.0:1789264107.290430:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1789264107.530053:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322694144:0@lo:41: 00000100:00100000:0.0:1789264107.530122:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264107.530241:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322694144 00000100:00100000:1.0:1789264107.530249:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322694144 00000100:00100000:1.0:1789264107.530303:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789264107.530311:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322694144:12345-0@lo:41: 00000004:00000024:1.0:1789264107.530352:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789264107.530405:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322694144:12345-0@lo:41: Request processed in 94us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264107.530411:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789264107.530769:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322694144:0@lo:41: 00010000:00010000:2.0:1789264108.169973:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789264108.848115:0:8933:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789264108.848352:0:8933:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789264109.194890:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789264109.404578:0:8981:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789264109.404587:0:8981:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1789264110.089888:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789264110.089923:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322694272:0@lo:41: 00000100:00100000:0.0:1789264110.089996:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264110.090061:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322694272 00000100:00100000:0.0:1789264110.090079:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322694272 00000100:00100000:0.0:1789264110.090136:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789264110.090146:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322694272:12345-0@lo:41: 00000004:00000024:0.0:1789264110.090176:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789264110.090240:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322694272:12345-0@lo:41: Request processed in 94us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264110.090247:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789264110.090309:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322694272:0@lo:41: 00010000:00010000:2.0:1789264110.221356:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264111.242543:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264112.138378:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322694400:0@lo:13: 00000100:00100000:2.0:1789264112.138446:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264112.138624:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322694400 00000100:00100000:0.0:1789264112.138633:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322694400 00000100:00100000:0.0:1789264112.138693:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264112.138705:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322694400:12345-0@lo:13: 00002000:00000024:0.0:1789264112.138730:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264112.138793:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322694400:12345-0@lo:13: Request processed in 91us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264112.138801:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789264112.139002:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322694528:0@lo:13: 00000100:00100000:3.0:1789264112.139090:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264112.139129:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322694528 00000100:00100000:3.0:1789264112.139134:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322694528 00000100:00100000:3.0:1789264112.139160:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789264112.139166:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322694528:12345-0@lo:13: 00002000:00000024:3.0:1789264112.139198:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264112.139232:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322694528:12345-0@lo:13: Request processed in 65us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264112.139238:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789264112.139272:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3a8f348380 x1876179322694528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264112.139293:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789264112.139313:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322694528:0@lo:13: 00000100:00080000:2.0:1789264112.139407:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789264112.139432:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3abaa90a80 x1876179322694400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264112.139490:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1789264112.139505:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322694400:0@lo:13: 00000100:00100000:2.0:1789264112.139688:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789264112.139734:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322694784:0@lo:400: 00000100:00100000:2.0:1789264112.139781:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264112.139804:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322694656:0@lo:400: 00000100:00100000:2.0:1789264112.139841:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264112.139909:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322694656 00000100:00100000:0.0:1789264112.139915:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322694656 00000100:00100000:0.0:1789264112.139951:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789264112.139959:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:3623:x1876179322694656:12345-0@lo:400: 00000100:00100000:0.0:1789264112.139995:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:3623:x1876179322694656:12345-0@lo:400: Request processed in 37us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264112.140002:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789264112.140151:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322694656:0@lo:400: 00000100:00100000:1.0:1789264112.140167:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322695168:0@lo:400: 00000100:00100000:2.0:1789264112.140170:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322695296:0@lo:400: 00000100:00100000:1.0:1789264112.140207:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264112.140213:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264112.140252:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322695168 00000100:00100000:1.0:1789264112.140257:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322695168 00000100:00100000:2.0:1789264112.140269:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322694912:0@lo:400: 00000100:00100000:2.0:1789264112.140307:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264112.140320:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322695424:0@lo:400: 00000100:00100000:2.0:1789264112.140340:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264112.140348:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322694912 00000100:00100000:1.0:1789264112.140353:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322694912 00000100:00100000:2.0:1789264112.140361:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789264112.140370:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322695040:0@lo:400: 00000100:00100000:1.0:1789264112.140373:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789264112.140382:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322695168:12345-0@lo:400: 00000100:00100000:2.0:1789264112.140410:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264112.140456:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322694784 00000100:00100000:2.0:1789264112.140461:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322694784 00000100:00100000:1.0:1789264112.140501:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322695168:12345-0@lo:400: Request processed in 56us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264112.140510:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789264112.140525:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789264112.140532:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322694912:12345-0@lo:400: 00000100:00100000:1.0:1789264112.140566:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322694912:12345-0@lo:400: Request processed in 36us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264112.140572:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789264112.140595:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322695168:0@lo:400: 00000100:00100000:1.0:1789264112.140618:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322694912:0@lo:400: 00000100:00100000:1.0:1789264112.140647:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322695296 00000100:00100000:1.0:1789264112.140651:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322695296 00000100:00100000:3.0:1789264112.140664:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322695424 00000100:00100000:3.0:1789264112.140670:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322695424 00000100:00100000:1.0:1789264112.140681:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322695040 00000100:00100000:1.0:1789264112.140686:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322695040 00000100:00100000:3.0:1789264112.140704:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789264112.140721:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789264112.140730:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322695296:12345-0@lo:400: 00000100:00080000:0.0:1789264112.140772:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789264112.140777:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264112.140797:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322695296:12345-0@lo:400: Request processed in 68us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264112.140798:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789264112.140808:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789264112.140809:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789264112.140829:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789264112.140837:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322695424:12345-0@lo:400: 00010000:00080000:0.0:1789264112.140842:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3aae23f800 x1876179322695296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264112.140854:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322695296:0@lo:400: 00000100:00100000:0.0:1789264112.140968:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789264112.140976:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322695040:12345-0@lo:400: 00000100:00100000:1.0:1789264112.140989:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322695424:12345-0@lo:400: Request processed in 152us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264112.141002:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789264112.141017:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322695040:12345-0@lo:400: Request processed in 42us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264112.141026:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789264112.141036:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3aae23ed80 x1876179322695040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264112.141060:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322695040:0@lo:400: 00010000:00080000:1.0:1789264112.141073:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3aae23df80 x1876179322695424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264112.141082:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322695424:0@lo:400: 00000100:00100000:3.0:1789264112.141202:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322694784:12345-0@lo:400: 00000100:00100000:3.0:1789264112.141248:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322694784:12345-0@lo:400: Request processed in 536us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264112.141255:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789264112.141471:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3aae23dc00 x1876179322694784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264112.141481:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322694784:0@lo:400: 00010000:00010000:1.0:1789264112.271179:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264112.649866:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322695552:0@lo:41: 00000100:00100000:3.0:1789264112.649944:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264112.650130:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322695552 00000100:00100000:2.0:1789264112.650138:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322695552 00000100:00100000:2.0:1789264112.650201:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789264112.650266:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322695552:12345-0@lo:41: 00000004:00000024:2.0:1789264112.650307:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789264112.650363:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322695552:12345-0@lo:41: Request processed in 153us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264112.650369:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789264112.650655:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322695552:0@lo:41: 00010000:00010000:1.0:1789264113.290299:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264114.314105:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264115.214784:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322695680:0@lo:41: 00000100:00100000:3.0:1789264115.214855:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264115.214916:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322695680 00000100:00100000:0.0:1789264115.214925:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322695680 00000100:00100000:0.0:1789264115.214997:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789264115.215005:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322695680:12345-0@lo:41: 00000004:00000024:0.0:1789264115.215040:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789264115.215092:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322695680:12345-0@lo:41: Request processed in 88us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264115.215100:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789264115.215296:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322695680:0@lo:41: 00010000:00010000:2.0:1789264115.340324:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789264116.003355:0:9480:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789264116.003360:0:9480:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789264116.003361:0:9480:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789264116.004038:0:9480:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c3ab7f50000 00000020:01000004:2.0:1789264116.004055:0:9480:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789264116.004069:0:9480:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789264116.004081:0:9480:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c3ab6920000) 00000020:00000080:2.0:1789264116.004097:0:9480:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789264116.050292:0:9480:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789264116.050354:0:9480:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1789264116.070022:0:9480:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789264116.072641:0:9480:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789264116.072664:0:9480:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789264116.072678:0:9480:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xecaf9f2f14ed6a5e 00000020:01000004:3.0:1789264116.072686:0:9480:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789264116.072708:0:9480:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.144@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789264116.072712:0:9480:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789264116.072719:0:9480:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789264116.072765:0:9480:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789264116.072770:0:9480:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789264116.085047:0:9480:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789264116.085083:0:9480:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.144@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789264116.085087:0:9480:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789264116.085089:0:9480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789264116.085090:0:9480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789264116.085091:0:9480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789264116.085092:0:9480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789264116.085093:0:9480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789264116.085095:0:9480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789264116.085096:0:9480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789264116.085097:0:9480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789264116.085099:0:9480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789264116.085100:0:9480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789264116.085104:0:9480:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789264116.085106:0:9480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789264116.085220:0:9480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789264116.085221:0:9480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789264116.085222:0:9480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789264116.085223:0:9480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789264116.085225:0:9480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789264116.085226:0:9480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789264116.085227:0:9480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789264116.085228:0:9480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789264116.085229:0:9480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789264116.085230:0:9480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789264116.085264:0:9480:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789264116.086055:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322695808:0@lo:253: 00000100:00100000:3.0:1789264116.086141:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264116.086201:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa443d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789264116.086309:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322695808 00000100:00100000:2.0:1789264116.086317:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322695808 00000100:00100000:2.0:1789264116.086382:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789264116.086394:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:9480:x1876179322695808:12345-0@lo:253: 20000000:01000000:2.0:1789264116.086433:0:6482:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789264116.086792:0:6482:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789264116.086799:0:6482:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789264116.086802:0:6482:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789264116.087079:0:6482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789264116.087224:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1789264116.087237:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789264116.087255:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1789264116.087308:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789264116.087324:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1789264116.087341:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1789264116.087492:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1789264116.087507:0:6482:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.144@tcp 20000000:01000000:3.0:1789264116.087509:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:3.0:1789264116.087521:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1789264116.087526:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789264116.087536:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1789264116.087540:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:3.0:1789264116.087549:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1789264116.087554:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789264116.087563:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1789264116.087574:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1789264116.087816:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1789264116.087829:0:6482:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.144@tcp 20000000:01000000:3.0:1789264116.087831:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:3.0:1789264116.087847:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1789264116.087853:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789264116.087868:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1789264116.087875:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:3.0:1789264116.087888:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1789264116.087896:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789264116.087906:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1789264116.087922:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1789264116.089912:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1789264116.089948:0:6482:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.144@tcp 20000000:01000000:3.0:1789264116.089950:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:3.0:1789264116.089965:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1789264116.089970:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789264116.089980:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1789264116.089984:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:3.0:1789264116.089994:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1789264116.089999:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789264116.090008:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1789264116.090020:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1789264116.090032:0:6482:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789264116.090034:0:6482:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789264116.090037:0:6482:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789264116.090077:0:6482:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789264116.090080:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789264116.090941:0:9486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1789264116.090980:0:9486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1789264116.090990:0:9486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789264116.091174:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789264116.091367:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1789264116.091386:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1789264116.091398:0:6482:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789264116.091400:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789264116.091969:0:9487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1789264116.091992:0:9487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1789264116.092005:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1789264116.092116:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1789264116.092136:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1789264116.092150:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1789264116.092160:0:6482:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789264116.092162:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789264116.092729:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1789264116.092947:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1789264116.092983:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1789264116.093142:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1789264116.093170:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1789264116.093189:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1789264116.093200:0:6482:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789264116.093202:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789264116.093656:0:9489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1789264116.093675:0:9489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1789264116.093689:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1789264116.093939:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1789264116.093974:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1789264116.093989:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1789264116.094000:0:6482:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789264116.094002:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789264116.095632:0:9490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1789264116.096082:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1789264116.096110:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1789264116.096124:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:3.0:1789264116.096141:0:6482:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789264116.096158:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096176:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed695b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6954 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096184:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a80030200/0xecaf9f2f14ed6985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed697e expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096191:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed69bd expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096209:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed69e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed69d9 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096216:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6a0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a03 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096222:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a1f expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096229:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3ab5623a00/0xecaf9f2f14ed6a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a42 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096235:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096280:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3ab5623a00/0xecaf9f2f14ed6a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6a42 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096294:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3ab5623a00/0xecaf9f2f14ed6a50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a42 expref: 21 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.096307:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322695936:0@lo:104: 00000100:00100000:3.0:1789264116.096365:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789264116.096419:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6a1f expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096428:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a1f expref: 21 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.096435:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322696064:0@lo:104: 00000100:00100000:3.0:1789264116.096465:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789264116.096500:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6a03 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096508:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6a0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a03 expref: 21 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.096516:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322696192:0@lo:104: 00000100:00100000:3.0:1789264116.096537:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789264116.096553:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed69e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed69d9 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096560:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed69e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed69d9 expref: 21 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.096567:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322696320:0@lo:104: 00000100:00100000:3.0:1789264116.096600:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789264116.096616:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed69bd expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096624:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed69bd expref: 21 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.096632:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322696448:0@lo:104: 00000100:00100000:3.0:1789264116.096650:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789264116.096665:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a80030200/0xecaf9f2f14ed6985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed697e expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096672:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a80030200/0xecaf9f2f14ed6985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed697e expref: 21 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.096691:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322696576:0@lo:104: 00000100:00100000:3.0:1789264116.096713:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789264116.096729:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed695b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6954 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.096737:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed695b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6954 expref: 21 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.096770:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322696704:0@lo:104: 00000100:00100000:3.0:1789264116.096811:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa443000 going to sleep for 11 seconds 00000100:00100000:1.0:1789264116.096988:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789264116.097007:0:6474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.097028:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322695936 00000100:00100000:1.0:1789264116.097034:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322695936 00000100:00100000:1.0:1789264116.097065:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322696064 00000100:00100000:1.0:1789264116.097068:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322696064 00000100:00100000:1.0:1789264116.097078:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322696192 00000100:00100000:1.0:1789264116.097080:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322696192 00000100:00100000:1.0:1789264116.097089:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322696320 00000100:00100000:1.0:1789264116.097091:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322696320 00000100:00100000:1.0:1789264116.097099:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322696448 00000100:00100000:1.0:1789264116.097101:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322696448 00000100:00100000:1.0:1789264116.097110:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322696576 00000100:00100000:1.0:1789264116.097112:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322696576 00000100:00100000:1.0:1789264116.097120:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322696704 00000100:00100000:1.0:1789264116.097122:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322696704 00000100:00100000:1.0:1789264116.097134:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789264116.097142:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+9:6482:x1876179322695936:12345-0@lo:104: 00010000:00010000:1.0:1789264116.097153:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6a50 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097211:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789264116.097216:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+9:6482:x1876179322695936:12345-0@lo:104: Request processed in 76us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.097223:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789264116.097238:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789264116.097244:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+8:6482:x1876179322696064:12345-0@lo:104: 00010000:00010000:1.0:1789264116.097250:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097291:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789264116.097296:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+8:6482:x1876179322696064:12345-0@lo:104: Request processed in 53us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.097310:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789264116.097321:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789264116.097326:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+7:6482:x1876179322696192:12345-0@lo:104: 00010000:00010000:1.0:1789264116.097333:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6a0a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097361:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789264116.097366:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+7:6482:x1876179322696192:12345-0@lo:104: Request processed in 41us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.097372:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789264116.097382:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789264116.097387:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+6:6482:x1876179322696320:12345-0@lo:104: 00010000:00010000:1.0:1789264116.097393:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed69e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097416:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789264116.097420:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+6:6482:x1876179322696320:12345-0@lo:104: Request processed in 34us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.097426:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789264116.097434:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789264116.097439:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:6482:x1876179322696448:12345-0@lo:104: 00010000:00010000:1.0:1789264116.097445:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed69c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097465:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789264116.097470:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:6482:x1876179322696448:12345-0@lo:104: Request processed in 31us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.097481:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789264116.097491:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789264116.097496:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39824b2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:6482:x1876179322696576:12345-0@lo:104: 00010000:00010000:1.0:1789264116.097502:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6985 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097524:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1789264116.097528:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39824b2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:6482:x1876179322696576:12345-0@lo:104: Request processed in 33us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.097533:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789264116.097556:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789264116.097562:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:6482:x1876179322696704:12345-0@lo:104: 00010000:00010000:1.0:1789264116.097568:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed695b expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097604:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1789264116.097609:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:6482:x1876179322696704:12345-0@lo:104: Request processed in 48us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.097614:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789264116.097630:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1789264116.097636:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6a50 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097643:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264116.097646:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6a50 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097663:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6a50 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264116.097671:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6a50 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264116.097677:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789264116.097700:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a50 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097707:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264116.097726:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a50 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097733:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6a42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a50 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097770:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789264116.097774:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097888:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622c00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264116.097891:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097898:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264116.097903:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264116.097915:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789264116.097930:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097936:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264116.097951:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097957:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622c00/0xecaf9f2f14ed6a1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097968:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789264116.097970:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6a0a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097976:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36be00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264116.097979:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6a0a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.097985:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6a0a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264116.097990:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6a0a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264116.097995:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789264116.098006:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a0a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098012:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264116.098023:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a0a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098029:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6a03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a0a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098037:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789264116.098040:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed69e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098045:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264116.098047:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed69e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098053:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed69e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264116.098059:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed69e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264116.098063:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789264116.098075:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed69e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098080:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264116.098085:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed69e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098090:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623800/0xecaf9f2f14ed69d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed69e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098096:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789264116.098105:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed69c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098111:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264116.098114:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed69c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098120:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed69c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264116.098125:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed69c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264116.098130:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789264116.098141:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed69c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098147:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264116.098151:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed69c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098156:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623200/0xecaf9f2f14ed69bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed69c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098165:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789264116.098167:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6985 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098172:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264116.098174:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6985 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098189:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6985 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264116.098195:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6985 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264116.098200:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789264116.098212:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6985 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098218:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264116.098222:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6985 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098227:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b200/0xecaf9f2f14ed697e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6985 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098236:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264116.098238:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed695b expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098242:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264116.098245:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed695b expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098251:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed695b expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264116.098265:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed695b expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264116.098277:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789264116.098289:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed695b expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098295:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264116.098299:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed695b expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098306:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623000/0xecaf9f2f14ed6954 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed695b expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.098318:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264116.098319:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264116.098321:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264116.098328:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264116.098333:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264116.098345:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322696832:0@lo:103: 00000100:00100000:1.0:1789264116.098377:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.098406:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322697344:0@lo:103: 00000100:00100000:1.0:1789264116.098438:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.098462:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789264116.098467:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322697216:0@lo:103: 00000100:00100000:1.0:1789264116.098488:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.098515:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322696960:0@lo:103: 00000100:00100000:1.0:1789264116.098538:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.098555:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322697472:0@lo:103: 00000100:00100000:1.0:1789264116.098585:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.098610:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789264116.098615:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322697088:0@lo:103: 00000100:00100000:1.0:1789264116.098636:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.098645:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322697600:0@lo:103: 00000100:00100000:1.0:1789264116.098676:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.098697:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322696832 00000100:00100000:1.0:1789264116.098702:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322696832 00010000:00010000:1.0:1789264116.098723:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3ab5623a00/0xecaf9f2f14ed6a50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a42 expref: 22 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264116.098739:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322697344 00000100:00100000:1.0:1789264116.098764:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322697344 00010000:00010000:1.0:1789264116.098776:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed69bd expref: 23 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.099040:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322695936:0@lo:104: 00000100:00100000:3.0:1789264116.099050:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322696064:0@lo:104: 00000100:00100000:3.0:1789264116.099058:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322696192:0@lo:104: 00000100:00100000:3.0:1789264116.099065:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322696320:0@lo:104: 00000100:00100000:3.0:1789264116.099071:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322696448:0@lo:104: 00000100:00100000:3.0:1789264116.099078:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322696576:0@lo:104: 00000100:00100000:3.0:1789264116.099086:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876179322696704:0@lo:104: 00010000:00010000:3.0:1789264116.099114:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264116.099163:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322697216 00000100:00100000:1.0:1789264116.099168:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322697216 00010000:00010000:1.0:1789264116.099181:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed69e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed69d9 expref: 24 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264116.099191:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322696960 00000100:00100000:1.0:1789264116.099193:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322696960 00010000:00010000:1.0:1789264116.099201:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a1f expref: 25 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264116.099210:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322697472 00000100:00100000:1.0:1789264116.099213:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322697472 00010000:00010000:1.0:1789264116.099222:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a80030200/0xecaf9f2f14ed6985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed697e expref: 26 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264116.099231:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322697088 00000100:00100000:1.0:1789264116.099234:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322697088 00010000:00010000:1.0:1789264116.099252:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6a0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a03 expref: 27 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264116.099273:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322697600 00000100:00100000:1.0:1789264116.099275:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322697600 00010000:00010000:1.0:1789264116.099285:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed695b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6954 expref: 28 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264116.099296:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789264116.099302:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+28:3623:x1876179322696832:12345-0@lo:103: 00010000:00010000:1.0:1789264116.099313:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264116.099317:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3ab5623a00/0xecaf9f2f14ed6a50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a42 expref: 28 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.099326:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3ab5623a00/0xecaf9f2f14ed6a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a42 expref: 28 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.099339:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5623a00/0xecaf9f2f14ed6a50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a42 expref: 28 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.099351:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264116.099435:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+27:3623:x1876179322696832:12345-0@lo:103: Request processed in 132us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.099442:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789264116.099457:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789264116.099463:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+26:3623:x1876179322697344:12345-0@lo:103: 00010000:00010000:1.0:1789264116.099471:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264116.099475:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed69bd expref: 26 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.099493:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed69bd expref: 26 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.099502:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36b600/0xecaf9f2f14ed69c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed69bd expref: 26 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.099510:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264116.099532:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+25:3623:x1876179322697344:12345-0@lo:103: Request processed in 69us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.099537:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789264116.099551:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789264116.099557:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3623:x1876179322697216:12345-0@lo:103: 00010000:00010000:1.0:1789264116.099564:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264116.099567:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed69e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed69d9 expref: 24 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.099587:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed69e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed69d9 expref: 24 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.099596:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed69e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed69d9 expref: 24 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.099603:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264116.099624:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:3623:x1876179322697216:12345-0@lo:103: Request processed in 68us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.099630:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789264116.099641:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789264116.099647:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2785050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:3624:x1876179322696960:12345-0@lo:103: 00010000:00010000:1.0:1789264116.099659:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264116.099663:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a1f expref: 22 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.099670:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a1f expref: 22 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.099678:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6a26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a1f expref: 22 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.099686:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264116.099720:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2785050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:3624:x1876179322696960:12345-0@lo:103: Request processed in 73us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.099726:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789264116.100025:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322696960:0@lo:103: 00000100:00100000:2.0:1789264116.100093:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322696832:0@lo:103: 00000100:00100000:2.0:1789264116.100100:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322697344:0@lo:103: 00000100:00100000:2.0:1789264116.100112:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322697216:0@lo:103: 00000100:00100000:1.0:1789264116.100158:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789264116.100166:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:3624:x1876179322697472:12345-0@lo:103: 00010000:00010000:1.0:1789264116.100174:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264116.100179:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a80030200/0xecaf9f2f14ed6985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed697e expref: 20 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100186:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a80030200/0xecaf9f2f14ed6985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed697e expref: 20 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100197:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a80030200/0xecaf9f2f14ed6985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed697e expref: 20 pid: 6482 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100206:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264116.100277:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:3624:x1876179322697472:12345-0@lo:103: Request processed in 112us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.100292:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789264116.100306:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789264116.100312:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:3624:x1876179322697088:12345-0@lo:103: 00010000:00010000:1.0:1789264116.100320:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264116.100329:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6a0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a03 expref: 18 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100337:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a03 expref: 18 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.100340:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322697472:0@lo:103: 00010000:00010000:1.0:1789264116.100347:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6a0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a03 expref: 18 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100355:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264116.100385:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:3624:x1876179322697088:12345-0@lo:103: Request processed in 74us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.100391:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789264116.100404:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789264116.100410:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:3624:x1876179322697600:12345-0@lo:103: 00010000:00010000:1.0:1789264116.100417:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264116.100421:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed695b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6954 expref: 16 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100431:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed695b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6954 expref: 16 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100439:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed695b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6954 expref: 16 pid: 6485 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100460:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100467:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100481:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100488:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100495:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100500:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100506:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36ae00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264116.100510:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100516:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.100548:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322697088:0@lo:103: 00010000:00010000:1.0:1789264116.100631:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.100631:0:6482:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.100640:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.100643:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264116.100646:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6a65 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789264116.100659:0:6482:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789264116.100678:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:3624:x1876179322697600:12345-0@lo:103: Request processed in 268us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.100692:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789264116.100987:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322697600:0@lo:103: 00000100:00100000:0.0:1789264116.102462:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:9480:x1876179322695808:12345-0@lo:253: Request processed in 16066us (16316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264116.102480:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789264116.102740:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322695808:0@lo:253: 10000000:01000000:3.0:1789264116.102769:0:9480:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789264116.102772:0:9480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789264116.102774:0:9480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789264116.102775:0:9480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789264116.102777:0:9480:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789264116.102778:0:9480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789264116.102789:0:9480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789264116.102791:0:9480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789264116.102792:0:9480:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789264116.102794:0:9480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789264116.102795:0:9480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789264116.102814:0:9480:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c3ab7f50000 from lustre-OST0001 10000000:01000000:3.0:1789264116.102842:0:9480:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789264116.102846:0:9480:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789264116.102865:0:9480:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c3aaa494d28 local copy 10000000:01000000:3.0:1789264116.102869:0:9480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789264116.102901:0:9480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.102911:0:9480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.102920:0:9480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.102937:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322697728:0@lo:101: 00000100:00100000:3.0:1789264116.102971:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264116.103010:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa443600 going to sleep for 11 seconds 00000100:00100000:2.0:1789264116.103151:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322697728 00000100:00100000:2.0:1789264116.103158:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322697728 00000100:00100000:2.0:1789264116.103201:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789264116.103211:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+14:9480:x1876179322697728:12345-0@lo:101: 00010000:00010000:2.0:1789264116.103223:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264116.103236:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5623600/0xecaf9f2f14ed6a73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6a6c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264116.103268:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5623600/0xecaf9f2f14ed6a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a6c expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264116.103278:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5623600/0xecaf9f2f14ed6a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a6c expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264116.103286:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623600, rc 0) 00000100:00100000:2.0:1789264116.103325:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:9480:x1876179322697728:12345-0@lo:101: Request processed in 117us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264116.103331:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789264116.103524:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322697728:0@lo:101: 00010000:00010000:1.0:1789264116.103534:0:9480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xecaf9f2f14ed6a73 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.103540:0:9480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xecaf9f2f14ed6a73 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264116.103614:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983112680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322697856:0@lo:501: 00000100:00100000:1.0:1789264116.103641:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.103675:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8b8f9180 going to sleep for 11 seconds 00000100:00100000:0.0:1789264116.104003:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322697856 00000100:00100000:0.0:1789264116.104008:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322697856 00000100:00100000:0.0:1789264116.104127:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789264116.104135:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:9480:x1876179322697856:12345-0@lo:501: 00000100:00100000:0.0:1789264116.104210:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:9480:x1876179322697856:12345-0@lo:501: Request processed in 75us (567us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789264116.104216:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789264116.104302:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983112680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322697856:0@lo:501: 10000000:01000000:3.0:1789264116.104375:0:9480:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789264116.104396:0:9480:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789264116.104402:0:9480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xecaf9f2f14ed6a73 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.104410:0:9480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xecaf9f2f14ed6a73 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.104417:0:9480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xecaf9f2f14ed6a73 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.104440:0:9480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789264116.104462:0:9480:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c3ab7f50000 10000000:01000000:3.0:1789264116.104467:0:9480:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789264116.104471:0:9480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789264116.104474:0:9480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789264116.104478:0:9480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789264116.104480:0:9480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789264116.104497:0:9480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.104504:0:9480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.104512:0:9480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.104525:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322697984:0@lo:101: 00000100:00100000:3.0:1789264116.104552:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264116.104589:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322697984 00000100:00100000:3.0:1789264116.104593:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa443000 going to sleep for 11 seconds 00000100:00100000:0.0:1789264116.104594:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322697984 00000100:00100000:0.0:1789264116.104629:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789264116.104636:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:9480:x1876179322697984:12345-0@lo:101: 00010000:00010000:2.0:1789264116.104637:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264116.104644:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xecaf9f2f14ed6a73 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.104644:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264116.104653:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed6a81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6a7a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264116.104661:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36ba00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264116.104664:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xecaf9f2f14ed6a73 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.104667:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed6a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a7a expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264116.104672:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xecaf9f2f14ed6a73 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.104675:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed6a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a7a expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264116.104679:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xecaf9f2f14ed6a73 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.104683:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a80031c00, rc 0) 10000000:01000000:2.0:1789264116.104685:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789264116.104700:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xecaf9f2f14ed6a73 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264116.104706:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789264116.104722:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xecaf9f2f14ed6a73 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264116.104724:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:9480:x1876179322697984:12345-0@lo:101: Request processed in 88us (171us total) trans 0 rc 0/0 00010000:00010000:2.0:1789264116.104729:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6a6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xecaf9f2f14ed6a73 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264116.104730:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00010000:2.0:1789264116.104740:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264116.104762:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264116.104765:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264116.104770:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789264116.104947:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322697984:0@lo:101: 00010000:00010000:1.0:1789264116.104958:0:9480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a81 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.104966:0:9480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6a81 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264116.104995:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322698112:0@lo:103: 00000100:00100000:2.0:1789264116.105023:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264116.105087:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322698112 00000100:00100000:3.0:1789264116.105091:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322698112 00000100:00100000:1.0:1789264116.105094:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983112d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322698240:0@lo:501: 00000100:00100000:1.0:1789264116.105119:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264116.105127:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789264116.105134:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:3623:x1876179322698112:12345-0@lo:103: 00010000:00010000:3.0:1789264116.105143:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264116.105153:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5623600/0xecaf9f2f14ed6a73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a6c expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.105163:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264116.105174:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8b8f9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264116.105199:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:3623:x1876179322698112:12345-0@lo:103: Request processed in 65us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264116.105205:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264116.105220:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322698112:0@lo:103: 00000100:00100000:2.0:1789264116.105249:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322698240 00000100:00100000:2.0:1789264116.105253:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322698240 00000100:00100000:2.0:1789264116.105307:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789264116.105314:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:9480:x1876179322698240:12345-0@lo:501: 00000100:00100000:2.0:1789264116.105405:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:9480:x1876179322698240:12345-0@lo:501: Request processed in 92us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264116.105411:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789264116.105691:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983112d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322698240:0@lo:501: 00000100:00100000:1.0:1789264116.105869:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983112d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322698368:0@lo:503: 00000100:00100000:1.0:1789264116.105910:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.105985:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8b8f9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264116.106056:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322698368 00000100:00100000:3.0:1789264116.106061:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322698368 00000100:00100000:3.0:1789264116.106123:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789264116.106131:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:9480:x1876179322698368:12345-0@lo:503: 00000100:00100000:3.0:1789264116.106226:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:9480:x1876179322698368:12345-0@lo:503: Request processed in 95us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264116.106233:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789264116.106308:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983112d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322698368:0@lo:503: 00000040:00080000:1.0:1789264116.106564:0:9480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789264116.106623:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983112d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322698496:0@lo:502: 00000100:00100000:1.0:1789264116.106661:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.107295:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8b8f9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789264116.107377:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322698496 00000100:00100000:0.0:1789264116.107383:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322698496 00000100:00100000:0.0:1789264116.107420:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789264116.107427:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:9480:x1876179322698496:12345-0@lo:502: 00000100:00100000:0.0:1789264116.107693:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:9480:x1876179322698496:12345-0@lo:502: Request processed in 265us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264116.107713:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789264116.107961:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983112d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322698496:0@lo:502: 00000040:00080000:0.0:1789264116.108276:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789264116.108307:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789264116.108321:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789264116.108334:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789264116.108346:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789264116.108360:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789264116.108387:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322698624:0@lo:502: 00000100:00100000:0.0:1789264116.108566:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264116.108598:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789264116.108657:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322698624 00000100:00100000:3.0:1789264116.108663:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322698624 00000100:00100000:3.0:1789264116.108788:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789264116.108798:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:9480:x1876179322698624:12345-0@lo:502: 00000100:00100000:3.0:1789264116.108882:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:9480:x1876179322698624:12345-0@lo:502: Request processed in 85us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264116.108889:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789264116.108932:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322698624:0@lo:502: 00000040:00080000:3.0:1789264116.108984:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789264116.108992:0:9480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1789264116.109911:0:9491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789264116.109920:0:9491:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789264116.109926:0:9491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264116.109928:0:9491:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789264116.109934:0:9491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789264116.109947:0:9491:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c3aba8eb370) 00000020:00000080:3.0:1789264116.109968:0:9491:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789264116.109974:0:9491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789264116.110046:0:9491:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3ab7f50000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789264116.110053:0:9491:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789264116.110059:0:9491:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xecaf9f2f14ed6a8f 00010000:00010000:3.0:1789264116.119327:0:9491:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1789264116.120926:0:9491:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789264116.128334:0:9491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789264116.128636:0:9491:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789264116.138398:0:9491:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789264116.138588:0:9491:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789264116.146419:0:9491:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1789264116.148443:0:9491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789264116.148454:0:9491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264116.148460:0:9491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264116.148462:0:9491:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789264116.148465:0:9491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789264116.148468:0:9491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264116.148470:0:9491:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789264116.148473:0:9491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789264116.148474:0:9491:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789264116.148496:0:9491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264116.148498:0:9491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264116.148500:0:9491:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789264116.148502:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789264116.151299:0:9480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789264116.151344:0:9480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789264116.151363:0:9480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a81 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.151376:0:9480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a81 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264116.151384:0:9480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3ab7f50000 from 1 10000000:01000000:3.0:1789264116.151387:0:9480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789264116.151422:0:9480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.151430:0:9480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.151449:0:9480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.151474:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322698752:0@lo:101: 00000100:00100000:3.0:1789264116.151540:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264116.151586:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa443a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789264116.151610:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322698752 00000100:00100000:3.0:1789264116.151617:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322698752 00000100:00100000:3.0:1789264116.151663:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789264116.151672:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aaa0bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:9480:x1876179322698752:12345-0@lo:101: 00010000:00010000:3.0:1789264116.151686:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264116.151698:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6a9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6a96 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.151739:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6a9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a96 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.151773:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6a9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a96 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.151781:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36aa00, rc 0) 00000100:00100000:3.0:1789264116.151819:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aaa0bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:9480:x1876179322698752:12345-0@lo:101: Request processed in 148us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264116.151826:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789264116.152004:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322698752:0@lo:101: 00010000:00010000:3.0:1789264116.152017:0:9480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a9d expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.152037:0:9480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6a9d expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.152121:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322698880:0@lo:501: 00000100:00100000:3.0:1789264116.152148:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264116.152164:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa443a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789264116.152180:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322698880 00000100:00100000:3.0:1789264116.152184:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322698880 00000100:00100000:3.0:1789264116.152222:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789264116.152229:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aaa0b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:9480:x1876179322698880:12345-0@lo:501: 00000100:00100000:3.0:1789264116.152328:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aaa0b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:9480:x1876179322698880:12345-0@lo:501: Request processed in 99us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264116.152335:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789264116.152368:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322698880:0@lo:501: 00000100:00100000:3.0:1789264116.152391:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699008:0@lo:503: 00000100:00100000:3.0:1789264116.152434:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264116.152449:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa443a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789264116.152466:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322699008 00000100:00100000:3.0:1789264116.152470:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322699008 00000100:00100000:3.0:1789264116.152489:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789264116.152495:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:9480:x1876179322699008:12345-0@lo:503: 00000100:00100000:3.0:1789264116.152572:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:9480:x1876179322699008:12345-0@lo:503: Request processed in 77us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264116.152578:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789264116.152778:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699008:0@lo:503: 00000040:00080000:0.0:1789264116.153002:0:9480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789264116.153067:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699136:0@lo:502: 00000100:00100000:0.0:1789264116.153114:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264116.153136:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789264116.153822:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322699136 00000100:00100000:3.0:1789264116.153836:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322699136 00000100:00100000:0.0:1789264116.154117:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789264116.154130:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:9480:x1876179322699136:12345-0@lo:502: 00000100:00100000:0.0:1789264116.154348:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:9480:x1876179322699136:12345-0@lo:502: Request processed in 221us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264116.154367:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789264116.154889:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699136:0@lo:502: 00000040:00080000:2.0:1789264116.156166:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789264116.156209:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789264116.156251:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699264:0@lo:502: 00000100:00100000:2.0:1789264116.156324:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264116.156354:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab55ea480 going to sleep for 11 seconds 00000100:00100000:3.0:1789264116.156616:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322699264 00000100:00100000:3.0:1789264116.156624:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322699264 00000100:00100000:3.0:1789264116.156668:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789264116.156677:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:9480:x1876179322699264:12345-0@lo:502: 00000100:00100000:2.0:1789264116.157211:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:9480:x1876179322699264:12345-0@lo:502: Request processed in 534us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264116.157220:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789264116.157322:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699264:0@lo:502: 00000040:00080000:2.0:1789264116.157431:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789264116.157444:0:9480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789264116.158104:0:9495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264116.158115:0:9495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264116.158117:0:9495:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789264116.158122:0:9495:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c3ab7f50000 00000020:00000080:3.0:1789264116.158125:0:9495:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789264116.158134:0:9495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264116.158136:0:9495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264116.158137:0:9495:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789264116.158139:0:9495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789264116.158268:0:9480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789264116.158290:0:9480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789264116.158354:0:9480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a9d expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264116.158367:0:9480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6a9d expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264116.158413:0:9480:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789264116.158416:0:9480:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c3ab7f50000 10000000:01000000:2.0:1789264116.158418:0:9480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c3ab7f50000 10000000:01000000:2.0:1789264116.158426:0:9480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789264116.158430:0:9480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3ab7f50000 from 1 10000000:01000000:2.0:1789264116.158432:0:9480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789264116.158458:0:9480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264116.158466:0:9480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264116.158477:0:9480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264116.158494:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699392:0@lo:101: 00000100:00100000:2.0:1789264116.158543:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264116.158583:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab26220c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264116.158627:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322699392 00000100:00100000:0.0:1789264116.158633:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322699392 00000100:00100000:0.0:1789264116.158667:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789264116.158676:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:9480:x1876179322699392:12345-0@lo:101: 00010000:00010000:0.0:1789264116.158687:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264116.158698:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a80031000/0xecaf9f2f14ed6aab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6aa4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.158728:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a80031000/0xecaf9f2f14ed6aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6aa4 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.158739:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a80031000/0xecaf9f2f14ed6aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6aa4 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.158773:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a80031000, rc 0) 00000100:00100000:0.0:1789264116.158806:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:9480:x1876179322699392:12345-0@lo:101: Request processed in 131us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264116.158812:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789264116.158987:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699392:0@lo:101: 00010000:00010000:2.0:1789264116.159001:0:9480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6aab expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264116.159010:0:9480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6aab expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264116.159083:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699520:0@lo:501: 00000100:00100000:2.0:1789264116.159121:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264116.159181:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab26220c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264116.159222:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322699520 00000100:00100000:0.0:1789264116.159226:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322699520 00000100:00100000:0.0:1789264116.159270:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789264116.159278:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:9480:x1876179322699520:12345-0@lo:501: 00000100:00100000:0.0:1789264116.159457:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:9480:x1876179322699520:12345-0@lo:501: Request processed in 178us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264116.159464:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789264116.159511:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699520:0@lo:501: 00000100:00100000:2.0:1789264116.159536:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699648:0@lo:503: 00000100:00100000:2.0:1789264116.159572:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264116.159630:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab26220c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264116.159668:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322699648 00000100:00100000:0.0:1789264116.159672:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322699648 00000100:00100000:0.0:1789264116.159918:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789264116.159929:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:9480:x1876179322699648:12345-0@lo:503: 00000100:00100000:2.0:1789264116.160048:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699648:0@lo:503: 00000100:00100000:0.0:1789264116.160049:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:9480:x1876179322699648:12345-0@lo:503: Request processed in 124us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264116.160055:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000040:00080000:2.0:1789264116.160272:0:9480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789264116.160341:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699776:0@lo:502: 00000100:00100000:2.0:1789264116.160377:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264116.160408:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab26220c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264116.160455:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322699776 00000100:00100000:0.0:1789264116.160459:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322699776 00000100:00100000:0.0:1789264116.160487:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789264116.160494:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:9480:x1876179322699776:12345-0@lo:502: 00000100:00100000:0.0:1789264116.160584:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:9480:x1876179322699776:12345-0@lo:502: Request processed in 90us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264116.160591:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789264116.160660:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699776:0@lo:502: 00000040:00080000:3.0:1789264116.161111:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789264116.161145:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789264116.161160:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789264116.161171:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789264116.161181:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789264116.161191:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789264116.161202:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789264116.161213:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789264116.161224:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789264116.161234:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789264116.161245:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789264116.161267:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789264116.161282:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789264116.161320:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789264116.161334:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789264116.161345:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789264116.161356:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789264116.161368:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789264116.161378:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789264116.161389:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789264116.161400:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789264116.161411:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789264116.161421:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789264116.161432:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789264116.161444:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789264116.161454:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789264116.161466:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789264116.161476:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789264116.161488:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789264116.161499:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789264116.161511:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789264116.161523:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789264116.161535:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789264116.161546:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789264116.161557:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789264116.161570:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789264116.161595:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1789264116.161606:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789264116.161618:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1789264116.161629:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1789264116.161641:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1789264116.161654:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1789264116.161666:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1789264116.161675:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1789264116.161685:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1789264116.161696:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1789264116.161730:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699904:0@lo:502: 00000100:00100000:2.0:1789264116.162186:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264116.162216:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264116.162424:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322699904 00000100:00100000:0.0:1789264116.162431:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322699904 00000100:00100000:0.0:1789264116.162465:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789264116.162473:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:9480:x1876179322699904:12345-0@lo:502: 00000100:00100000:0.0:1789264116.162563:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:9480:x1876179322699904:12345-0@lo:502: Request processed in 90us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264116.162570:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789264116.162578:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322699904:0@lo:502: 00000040:00080000:2.0:1789264116.162629:0:9480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1789264116.162643:0:9480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1789264116.163185:0:9496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789264116.163207:0:9496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c39833e19b8) 00000020:00000080:1.0:1789264116.163228:0:9496:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1789264116.163398:0:9496:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3ab7f50000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789264116.163402:0:9496:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c3ab7f50000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789264116.163403:0:9496:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3ab7f50000 3 00010000:00080000:1.0:1789264116.163426:0:9496:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3aaa7e1800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.144@tcp at head 00010000:00010000:1.0:1789264116.168085:0:9496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1789264116.168950:0:9496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789264116.169013:0:9496:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789264116.169025:0:9496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xecaf9f2f14ed6ab9 00000100:00080000:1.0:1789264116.169036:0:9496:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789264116.169042:0:9496:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c3aaa7e1800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264116.169073:0:9496:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983110a80 x1876179322700032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789264116.169148:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1876179322700032:0@lo:38: 00000100:00100000:2.0:1789264116.169209:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264116.169295:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322700032 00000100:00100000:3.0:1789264116.169303:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322700032 00000100:00100000:3.0:1789264116.169335:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789264116.169342:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1876179322700032:12345-0@lo:38: 00010000:00080000:3.0:1789264116.169362:0:6490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:3.0:1789264116.169404:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xecaf9f2f14ed6ac0 00000004:00100000:3.0:1789264116.169418:0:6490:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789264116.169445:0:6490:0:(import.c:65:import_set_state_nolock()) ffff9c3983121800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789264116.169500:0:9496:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789264116.169587:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322700544:0@lo:400: 00000100:00100000:1.0:1789264116.169618:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.169638:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322701056:0@lo:400: 00000100:00100000:1.0:1789264116.169664:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.169683:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789264116.169689:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983113100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322700160:0@lo:400: 00000100:00100000:1.0:1789264116.169709:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.169726:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322700672:0@lo:400: 00000100:00100000:1.0:1789264116.169765:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.169802:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983113b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322700416:0@lo:400: 00000100:00100000:1.0:1789264116.169825:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.169842:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322700928:0@lo:400: 00000100:00100000:1.0:1789264116.169870:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.169888:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789264116.169893:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322700288:0@lo:400: 00000100:00100000:1.0:1789264116.169914:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.169930:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322700800:0@lo:400: 00000100:00100000:1.0:1789264116.169950:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.169970:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322700544 00000100:00100000:1.0:1789264116.169974:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322700544 00000100:00100000:1.0:1789264116.170004:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322700288 00000100:00100000:1.0:1789264116.170006:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322700288 00000100:00100000:1.0:1789264116.170019:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789264116.170025:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322700544:12345-0@lo:400: 00000100:00100000:1.0:1789264116.170070:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322700544:12345-0@lo:400: Request processed in 44us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.170077:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789264116.170092:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789264116.170097:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322700288:12345-0@lo:400: 00000100:00100000:1.0:1789264116.170125:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322700288:12345-0@lo:400: Request processed in 28us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.170131:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789264116.170146:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322700160 00000100:00100000:1.0:1789264116.170149:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322700160 00000100:00100000:1.0:1789264116.170164:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322700672 00000100:00100000:1.0:1789264116.170167:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322700672 00000100:00100000:1.0:1789264116.170185:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322700416 00000100:00100000:1.0:1789264116.170188:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322700416 00000100:00100000:1.0:1789264116.170198:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322700800 00000100:00100000:1.0:1789264116.170200:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322700800 00000100:00100000:1.0:1789264116.170215:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789264116.170220:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322700160:12345-0@lo:400: 00000100:00100000:1.0:1789264116.170246:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322700160:12345-0@lo:400: Request processed in 26us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.170252:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789264116.170277:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789264116.170283:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322700672:12345-0@lo:400: 00000100:00100000:1.0:1789264116.170308:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322700672:12345-0@lo:400: Request processed in 26us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.170314:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789264116.170327:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789264116.170334:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322700416:12345-0@lo:400: 00000100:00100000:1.0:1789264116.171527:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322700416:12345-0@lo:400: Request processed in 1191us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.171936:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789264116.171960:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789264116.171970:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322700800:12345-0@lo:400: 00000100:00100000:1.0:1789264116.172003:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322700800:12345-0@lo:400: Request processed in 36us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.172009:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789264116.172037:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789264116.172042:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264116.172072:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322700288:0@lo:400: 00010000:00080000:1.0:1789264116.172087:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983112a00 x1876179322700800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264116.172097:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322700800:0@lo:400: 00010000:00080000:1.0:1789264116.172107:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983113b80 x1876179322700416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264116.172114:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983113b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322700416:0@lo:400: 00010000:00080000:1.0:1789264116.172152:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983113100 x1876179322700160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264116.172161:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983113100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322700160:0@lo:400: 00010000:00080000:1.0:1789264116.172171:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983110000 x1876179322700672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264116.172179:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322700672:0@lo:400: 00000100:00100000:1.0:1789264116.172189:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322700544:0@lo:400: 00000020:01000004:1.0:1789264116.172388:0:9496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789264116.172402:0:9496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c39833e4d28) 00000020:00000080:1.0:1789264116.172422:0:9496:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1789264116.172507:0:9496:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3ab7f50000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789264116.172511:0:9496:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c3ab7f50000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789264116.172514:0:9496:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3ab7f50000 3 00010000:00080000:1.0:1789264116.172539:0:9496:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3aba909800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.144@tcp at head 00010000:00010000:1.0:1789264116.174105:0:9496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:3.0:1789264116.175983:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876179322700032:12345-0@lo:38: Request processed in 6631us (6764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264116.175996:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789264116.176050:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322701056 00000100:00100000:3.0:1789264116.176059:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322701056 00000100:00100000:3.0:1789264116.176102:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322700928 00000100:00100000:3.0:1789264116.176106:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322700928 00000100:00100000:3.0:1789264116.176126:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789264116.176133:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322701056:12345-0@lo:400: 00000100:00100000:3.0:1789264116.176203:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322701056:12345-0@lo:400: Request processed in 70us (6537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264116.176210:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789264116.176222:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789264116.176228:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322700928:12345-0@lo:400: 00000020:00000080:1.0:1789264116.177436:0:9496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789264116.177492:0:9496:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000100:00100000:3.0:1789264116.177503:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322700928:12345-0@lo:400: Request processed in 1273us (7630us total) trans 0 rc 0/0 00000020:00000080:1.0:1789264116.177504:0:9496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xecaf9f2f14ed6ace 00000100:00080000:1.0:1789264116.177511:0:9496:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00100000:3.0:1789264116.177512:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789264116.177517:0:9496:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c3aba909800 using connection 192.168.203.144@tcp/0@lo 00000100:00080000:3.0:1789264116.177543:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264116.177544:0:9496:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3aae23dc00 x1876179322701184/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789264116.177558:0:9496:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789264116.178032:0:9498:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9c3aae23d880 x1876179322701312/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264116.178044:0:9498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8b8f9f00 going to sleep for 0 seconds 00010000:00080000:2.0:1789264116.184080:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983110a80 x1876179322700032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789264126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264116.184150:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789264116.184160:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789264116.184169:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789264116.184174:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789264116.184177:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa7e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789264116.184184:0:3621:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a607395d): req@ffff9c3aae23d880 x1876179322701312/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264116.184288:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1876179322700032:0@lo:38: 00000100:00100000:2.0:1789264116.184322:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3621:1876179322701184:0@lo:38: 00000100:00100000:2.0:1789264116.184389:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789264116.185176:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983111180 x1876179322701056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264116.185190:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322701056:0@lo:400: 00010000:00080000:1.0:1789264116.185436:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983111f80 x1876179322700928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264116.185446:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322700928:0@lo:400: 00000100:00100000:1.0:1789264116.185472:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322701184 00000100:00100000:1.0:1789264116.185478:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322701184 00000100:00100000:1.0:1789264116.185557:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789264116.185563:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3621:x1876179322701184:12345-0@lo:38: 00010000:00080000:1.0:1789264116.185589:0:9197:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:1.0:1789264116.185641:0:9197:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xecaf9f2f14ed6ad5 00000004:00100000:1.0:1789264116.185657:0:9197:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789264116.185699:0:9197:0:(import.c:65:import_set_state_nolock()) ffff9c39835f4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789264116.185792:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876179322701184:12345-0@lo:38: Request processed in 226us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.185799:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789264116.185968:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3aae23dc00 x1876179322701184/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789264126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264116.185978:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789264116.185984:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789264116.185990:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789264116.185994:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789264116.185996:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aba909800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789264116.186002:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3621:1876179322701184:0@lo:38: 00000040:00080000:1.0:1789264116.186074:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:1.0:1789264116.186300:0:9498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.186332:0:9498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8b8f9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264116.186384:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322701312 00000100:00100000:0.0:1789264116.186389:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322701312 00000100:00100000:0.0:1789264116.186438:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264116.186445:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9498:x1876179322701312:12345-0@lo:901: 00000100:00100000:0.0:1789264116.186526:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9498:x1876179322701312:12345-0@lo:901: Request processed in 81us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264116.186533:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789264116.186580:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789264116.186600:0:9498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3aae23d880 x1876179322701312/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789264132 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264116.186610:0:9498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23d880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9498:1876179322701312:0@lo:901: 00000020:01000000:3.0:1789264116.186738:0:9480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1789264116.187048:0:9480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789264116.187095:0:9480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6aab expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264116.187107:0:9480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6aab expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789264116.187155:0:9480:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789264116.187157:0:9480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789264116.187158:0:9480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789264116.187159:0:9480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789264116.187160:0:9480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789264116.187161:0:9480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789264116.187163:0:9480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789264116.187164:0:9480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789264116.187166:0:9480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789264116.187167:0:9480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789264116.187168:0:9480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789264116.187174:0:9480:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789264116.187176:0:9480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789264116.187178:0:9480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789264116.187179:0:9480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789264116.187180:0:9480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789264116.187181:0:9480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789264116.187182:0:9480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789264116.187183:0:9480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789264116.187184:0:9480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789264116.187185:0:9480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789264116.187186:0:9480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789264116.187187:0:9480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789264116.187201:0:9480:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789264116.187212:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322701440:0@lo:253: 00000100:00100000:3.0:1789264116.187247:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264116.187287:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789264116.187326:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322701440 00000100:00100000:1.0:1789264116.187334:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322701440 00000100:00100000:1.0:1789264116.187367:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789264116.187374:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:9480:x1876179322701440:12345-0@lo:253: 20000000:01000000:1.0:1789264116.187391:0:6484:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789264116.187402:0:6484:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789264116.198080:0:6484:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789264116.198108:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789264116.198204:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789264116.198214:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789264116.198232:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.198255:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed69d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed69cb expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.198271:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6a18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a11 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.198278:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.198313:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6a11 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.198327:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6a18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a11 expref: 17 pid: 6484 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264116.198340:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876179322701568:0@lo:104: 00000100:00100000:0.0:1789264116.198400:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789264116.198641:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed69d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed69cb expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.198650:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed69d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed69cb expref: 17 pid: 6484 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264116.198658:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa93b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876179322701696:0@lo:104: 00000100:00100000:0.0:1789264116.198680:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264116.198698:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789264116.198766:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322701568 00000100:00100000:1.0:1789264116.198890:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322701568 00000100:00100000:1.0:1789264116.198926:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322701696 00000100:00100000:1.0:1789264116.198930:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322701696 00000100:00100000:1.0:1789264116.198945:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789264116.198954:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:6506:x1876179322701568:12345-0@lo:104: 00010000:00010000:1.0:1789264116.198966:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6a18 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199032:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789264116.199038:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:6506:x1876179322701568:12345-0@lo:104: Request processed in 86us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.199046:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789264116.199072:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789264116.199078:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:6506:x1876179322701696:12345-0@lo:104: 00010000:00010000:1.0:1789264116.199085:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed69d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199119:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789264116.199124:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:6506:x1876179322701696:12345-0@lo:104: Request processed in 46us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.199129:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789264116.199146:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789264116.199151:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6a18 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199158:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264116.199162:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6a18 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199170:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6a18 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264116.199177:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6a18 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264116.199183:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789264116.199214:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a18 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199221:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264116.199238:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a18 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199245:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6a11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a18 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199266:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264116.199270:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed69d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199276:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36bc00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264116.199278:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed69d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199285:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed69d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264116.199291:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed69d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264116.199296:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789264116.199309:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed69d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199315:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264116.199329:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed69d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199345:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed69cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed69d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199357:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264116.199359:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264116.199361:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264116.199367:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264116.199379:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322701824:0@lo:103: 00000100:00100000:1.0:1789264116.199407:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.199438:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322701952:0@lo:103: 00000100:00100000:1.0:1789264116.199459:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264116.199486:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322701824 00000100:00100000:1.0:1789264116.199490:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322701824 00010000:00010000:1.0:1789264116.199505:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6a18 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a11 expref: 18 pid: 6484 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264116.199522:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322701952 00000100:00100000:1.0:1789264116.199525:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322701952 00010000:00010000:1.0:1789264116.199535:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed69d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed69cb expref: 19 pid: 6484 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264116.199554:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789264116.199560:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:3623:x1876179322701824:12345-0@lo:103: 00010000:00010000:1.0:1789264116.199570:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264116.199575:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6a18 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a11 expref: 19 pid: 6484 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199585:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6a18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a11 expref: 19 pid: 6484 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199606:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264116.199634:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:3623:x1876179322701824:12345-0@lo:103: Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.199640:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789264116.199654:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789264116.199660:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:3624:x1876179322701952:12345-0@lo:103: 00010000:00010000:1.0:1789264116.199667:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264116.199671:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed69d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed69cb expref: 18 pid: 6484 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199680:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed69d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed69cb expref: 18 pid: 6484 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199691:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199699:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789264116.199711:0:6477:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003560844s 00010000:00010000:1.0:1789264116.199715:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199722:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199728:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199733:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.199766:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a80031a00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264116.200092:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.200102:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.200111:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264116.200121:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264116.200154:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:3624:x1876179322701952:12345-0@lo:103: Request processed in 494us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264116.200161:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789264116.200203:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322701952:0@lo:103: 00000100:00100000:1.0:1789264116.200229:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322701824:0@lo:103: 00000100:00100000:2.0:1789264116.200317:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:9480:x1876179322701440:12345-0@lo:253: Request processed in 12941us (13066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264116.200326:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00010000:0.0:1789264116.201225:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6a18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a11 expref: 16 pid: 6484 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264116.201269:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876179322701568:0@lo:104: 00010000:00010000:0.0:1789264116.201284:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed69d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed69cb expref: 15 pid: 6484 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264116.201292:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa93b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876179322701696:0@lo:104: 00010000:00010000:0.0:1789264116.201311:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.201320:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.201325:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264116.201331:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a80031a00/0xecaf9f2f14ed6adc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264116.201433:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:9480:1876179322701440:0@lo:253: 10000000:01000000:3.0:1789264116.201444:0:9480:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789264116.201448:0:9480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789264116.201449:0:9480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789264116.201451:0:9480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789264116.201451:0:9480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789264116.201453:0:9480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789264116.201454:0:9480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789264116.201455:0:9480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789264116.201456:0:9480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789264116.201458:0:9480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789264116.201459:0:9480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789264116.201460:0:9480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789264116.201470:0:9480:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789264116.214615:0:9480:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789264116.214956:0:9480:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789264116.215336:0:9480:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789264116.215488:0:9480:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789264116.215689:0:9480:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789264116.216292:0:9480:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789264116.217728:0:9480:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789264116.227599:0:9480:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789264116.227610:0:9480:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789264116.227651:0:9480:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789264116.227689:0:9480:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789264116.227721:0:9480:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789264116.227739:0:9480:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789264116.228657:0:9480:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789264116.228888:0:9480:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789264116.361936:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789264117.015338:0:9553:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789264117.015571:0:9553:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789264117.258006:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789264117.258031:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322702080:0@lo:13: 00000100:00100000:2.0:1789264117.258101:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264117.258546:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322702080 00000100:00100000:3.0:1789264117.258555:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322702080 00000100:00100000:3.0:1789264117.258607:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789264117.258617:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322702080:12345-0@lo:13: 00002000:00000024:3.0:1789264117.258645:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264117.258713:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322702080:12345-0@lo:13: Request processed in 97us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264117.258720:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789264117.258812:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abaa93b80 x1876179322702080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264117.258829:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322702080:0@lo:13: 00000100:00100000:1.0:1789264117.259090:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322702208:0@lo:13: 00000100:00100000:1.0:1789264117.259123:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264117.259196:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322702208 00000100:00100000:3.0:1789264117.259200:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322702208 00000100:00100000:3.0:1789264117.259231:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789264117.259238:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322702208:12345-0@lo:13: 00002000:00000024:3.0:1789264117.259262:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264117.264727:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322702208:12345-0@lo:13: Request processed in 5481us (5594us total) trans 0 rc 0/0 00010000:00080000:1.0:1789264117.264727:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abaa91500 x1876179322702208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264117.264739:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789264117.264763:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322702208:0@lo:13: 00010000:00010000:2.0:1789264117.387704:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264117.784804:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322702336:0@lo:41: 00000100:00100000:1.0:1789264117.784873:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264117.785602:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322702336 00000100:00100000:0.0:1789264117.785612:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322702336 00000100:00100000:0.0:1789264117.785672:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789264117.785682:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322702336:12345-0@lo:41: 00000004:00000024:0.0:1789264117.785714:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789264117.787241:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322702336:12345-0@lo:41: Request processed in 1553us (2361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264117.787260:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789264117.788362:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322702336:0@lo:41: 00010000:00010000:3.0:1789264118.410359:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264119.435123:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264120.330497:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322702464:0@lo:41: 00000100:00100000:0.0:1789264120.330567:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264120.331320:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322702464 00000100:00100000:0.0:1789264120.331328:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322702464 00000100:00100000:0.0:1789264120.331389:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789264120.331400:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322702464:12345-0@lo:41: 00000004:00000024:0.0:1789264120.331430:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789264120.331489:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322702464:12345-0@lo:41: Request processed in 92us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264120.331496:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789264120.331610:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322702464:0@lo:41: 00010000:00010000:2.0:1789264120.464825:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789264121.062598:0:9843:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789264121.355013:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322702976:0@lo:400: 00000100:00100000:2.0:1789264121.355077:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264121.355186:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322703488:0@lo:400: 00000100:00100000:2.0:1789264121.355215:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264121.355237:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322702592:0@lo:400: 00000100:00100000:2.0:1789264121.355289:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322702848:0@lo:400: 00000100:00100000:3.0:1789264121.355326:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264121.355332:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264121.355367:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322703104:0@lo:400: 00000100:00100000:2.0:1789264121.355368:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1876179322703360:0@lo:400: 00000100:00100000:3.0:1789264121.355410:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264121.355416:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264121.355440:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322703616:0@lo:400: 00000100:00100000:2.0:1789264121.355444:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322703872:0@lo:400: 00000100:00100000:3.0:1789264121.355478:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264121.355493:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264121.355520:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322702976 00000100:00100000:3.0:1789264121.355527:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322702976 00000100:00100000:2.0:1789264121.355531:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789264121.355540:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322702720:0@lo:400: 00000100:00100000:3.0:1789264121.355571:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322703360 00000100:00100000:2.0:1789264121.355571:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264121.355576:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322703360 00000100:00100000:3.0:1789264121.355605:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322703872 00000100:00100000:3.0:1789264121.355608:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322703872 00000100:00100000:2.0:1789264121.355614:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322703232:0@lo:400: 00000100:00100000:3.0:1789264121.355626:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322702720 00000100:00100000:3.0:1789264121.355630:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322702720 00000100:00100000:3.0:1789264121.355721:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789264121.355738:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322702976:12345-0@lo:400: 00000100:00100000:1.0:1789264121.355771:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322703488 00000100:00100000:1.0:1789264121.355778:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322703488 00000100:00100000:1.0:1789264121.355818:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322703616 00000100:00100000:1.0:1789264121.355822:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322703616 00000100:00100000:1.0:1789264121.355839:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789264121.355845:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322703488:12345-0@lo:400: 00000100:00100000:1.0:1789264121.355880:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322703488:12345-0@lo:400: Request processed in 36us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264121.355887:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789264121.355901:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789264121.355907:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322703616:12345-0@lo:400: 00000100:00100000:1.0:1789264121.355954:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322703616:12345-0@lo:400: Request processed in 46us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264121.355960:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789264121.356085:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322702976:12345-0@lo:400: Request processed in 81us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264121.356096:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789264121.356116:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789264121.356123:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1876179322703360:12345-0@lo:400: 00000100:00100000:3.0:1789264121.356155:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1876179322703360:12345-0@lo:400: Request processed in 33us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264121.356164:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789264121.356164:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264121.356178:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322703232 00000100:00100000:3.0:1789264121.356183:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322703232 00000100:00100000:2.0:1789264121.356189:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322703744:0@lo:400: 00000100:00100000:3.0:1789264121.356203:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789264121.356213:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1876179322703872:12345-0@lo:400: 00000100:00100000:2.0:1789264121.356229:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789264121.356260:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abab42a00 x1876179322703360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264121.356265:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1876179322703872:12345-0@lo:400: Request processed in 53us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264121.356281:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789264121.356283:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1876179322703360:0@lo:400: 00000100:00100000:3.0:1789264121.356297:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322703744 00000100:00100000:3.0:1789264121.356302:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322703744 00010000:00080000:2.0:1789264121.356302:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ab301e680 x1876179322703872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264121.356314:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322703872:0@lo:400: 00000100:00100000:3.0:1789264121.356327:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789264121.356336:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322702720:12345-0@lo:400: 00000100:00100000:2.0:1789264121.356352:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322702848 00000100:00100000:2.0:1789264121.356358:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322702848 00000100:00100000:3.0:1789264121.356376:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322702720:12345-0@lo:400: Request processed in 41us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264121.356384:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789264121.356391:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322703104 00000100:00100000:2.0:1789264121.356396:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322703104 00000100:00100000:3.0:1789264121.356401:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789264121.356411:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322703232:12345-0@lo:400: 00000100:00100000:2.0:1789264121.356417:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789264121.356428:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322702848:12345-0@lo:400: 00000100:00100000:3.0:1789264121.356445:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322703232:12345-0@lo:400: Request processed in 35us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264121.356458:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789264121.356475:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322702848:12345-0@lo:400: Request processed in 49us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264121.356476:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789264121.356488:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789264121.356490:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322703744:12345-0@lo:400: 00000100:00100000:2.0:1789264121.356509:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789264121.356519:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322703104:12345-0@lo:400: 00000100:00100000:3.0:1789264121.356529:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322703744:12345-0@lo:400: Request processed in 42us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264121.356537:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789264121.356558:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322703104:12345-0@lo:400: Request processed in 41us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264121.356573:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322702592 00000100:00100000:2.0:1789264121.356575:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789264121.356579:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322702592 00000100:00100000:3.0:1789264121.356613:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789264121.356621:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:3625:x1876179322702592:12345-0@lo:400: 00010000:00080000:2.0:1789264121.356700:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abab42300 x1876179322702976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264121.356709:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322702976:0@lo:400: 00010000:00080000:2.0:1789264121.356719:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ab301ca80 x1876179322703488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264121.356728:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322703488:0@lo:400: 00010000:00080000:2.0:1789264121.356775:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abab40a80 x1876179322702720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264121.356784:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322702720:0@lo:400: 00010000:00080000:2.0:1789264121.356795:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abab42680 x1876179322703232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264121.356802:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322703232:0@lo:400: 00010000:00080000:2.0:1789264121.356811:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ab301ce00 x1876179322703744/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264121.356818:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322703744:0@lo:400: 00000100:00100000:2.0:1789264121.356826:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322702848:0@lo:400: 00000100:00080000:2.0:1789264121.356895:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789264121.356900:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789264121.356902:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789264121.356926:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322703104:0@lo:400: 00010000:00080000:2.0:1789264121.356935:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ab301d880 x1876179322703616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264121.356951:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322703616:0@lo:400: 00000100:00100000:3.0:1789264121.359185:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:3625:x1876179322702592:12345-0@lo:400: Request processed in 2556us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264121.359593:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322702592:0@lo:400: 00000100:00100000:3.0:1789264121.359670:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00010000:2.0:1789264121.483377:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789264121.699500:0:9895:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789264121.700016:0:9895:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789264122.378059:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789264122.378085:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322704000:0@lo:13: 00000100:00100000:0.0:1789264122.378152:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264122.379309:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322704000 00000100:00100000:1.0:1789264122.379321:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322704000 00000100:00100000:1.0:1789264122.379375:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789264122.379386:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322704000:12345-0@lo:13: 00002000:00000024:1.0:1789264122.379420:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264122.379616:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322704000:12345-0@lo:13: Request processed in 232us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264122.379651:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789264122.379909:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abaa90380 x1876179322704000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264122.379943:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322704000:0@lo:13: 00000100:00100000:1.0:1789264122.380031:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789264122.380045:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322704128:0@lo:13: 00000100:00100000:1.0:1789264122.380084:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264122.380507:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322704128 00000100:00100000:3.0:1789264122.380514:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322704128 00000100:00100000:3.0:1789264122.380564:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789264122.380575:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322704128:12345-0@lo:13: 00002000:00000024:3.0:1789264122.380591:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264122.380639:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322704128:12345-0@lo:13: Request processed in 66us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264122.380646:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789264122.380696:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abaa90380 x1876179322704128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264122.380724:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322704128:0@lo:13: 00010000:00010000:1.0:1789264122.507985:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264122.890085:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789264122.890393:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322704256:0@lo:41: 00000100:00100000:0.0:1789264122.890478:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264122.890529:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322704256 00000100:00100000:2.0:1789264122.890538:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322704256 00000100:00100000:2.0:1789264122.890603:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789264122.890614:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322704256:12345-0@lo:41: 00000004:00000024:2.0:1789264122.890645:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1789264122.890694:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322704256:12345-0@lo:41: Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264122.890701:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789264122.890923:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322704256:0@lo:41: 00010000:00010000:2.0:1789264123.531535:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789264124.022070:0:9996:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789264124.022338:0:9996:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789264124.554224:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789264124.673950:0:10044:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789264124.673962:0:10044:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 10000000:01000000:0.0:1789264124.938012:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789264124.938019:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3aba913000 from 39 10000000:01000000:0.0:1789264124.938024:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789264124.938064:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264124.938092:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264124.938104:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264124.938127:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322704384:0@lo:101: 00000100:00100000:0.0:1789264124.938189:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264124.938258:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae144240 going to sleep for 11 seconds 00000100:00100000:1.0:1789264124.938382:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322704384 00000100:00100000:1.0:1789264124.938389:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322704384 00000100:00100000:1.0:1789264124.938442:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789264124.938451:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:6487:x1876179322704384:12345-0@lo:101: 00010000:00010000:1.0:1789264124.938464:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264124.938476:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed6aea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6ae3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.938499:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed6aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6ae3 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.938510:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed6aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6ae3 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.938519:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f095000, rc 0) 00000100:00100000:1.0:1789264124.938566:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322704384:12345-0@lo:101: Request processed in 115us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264124.938573:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789264124.938957:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322704384:0@lo:101: 00010000:00010000:0.0:1789264124.938972:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264124.938981:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264124.939039:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322704512:0@lo:501: 00000100:00100000:0.0:1789264124.939067:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264124.939095:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae144240 going to sleep for 11 seconds 00000100:00100000:2.0:1789264124.939137:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322704512 00000100:00100000:2.0:1789264124.939141:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322704512 00000100:00100000:2.0:1789264124.939172:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789264124.939179:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322704512:12345-0@lo:501: 00000100:00100000:2.0:1789264124.939308:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322704512:12345-0@lo:501: Request processed in 129us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.939315:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789264124.939381:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322704512:0@lo:501: 00000100:00100000:0.0:1789264124.939405:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322704640:0@lo:503: 00000100:00100000:0.0:1789264124.939514:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264124.939535:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae144240 going to sleep for 11 seconds 00000100:00100000:1.0:1789264124.939553:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322704640 00000100:00100000:1.0:1789264124.939558:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322704640 00000100:00100000:1.0:1789264124.939589:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789264124.939595:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322704640:12345-0@lo:503: 00000100:00100000:1.0:1789264124.939679:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322704640:12345-0@lo:503: Request processed in 83us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264124.939685:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789264124.939815:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322704640:0@lo:503: 00000100:00100000:0.0:1789264124.940150:0:10057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10057:1876179322704768:0@lo:502: 00000100:00100000:0.0:1789264124.940188:0:10057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264124.940222:0:10057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae144d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789264124.940261:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322704768 00000100:00100000:2.0:1789264124.940266:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322704768 00000100:00100000:2.0:1789264124.940302:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789264124.940309:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:10057:x1876179322704768:12345-0@lo:502: 00000100:00100000:2.0:1789264124.940395:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:10057:x1876179322704768:12345-0@lo:502: Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.940401:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789264124.940536:0:10057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10057:1876179322704768:0@lo:502: 00000100:00100000:0.0:1789264124.940575:0:10057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10057:1876179322704896:0@lo:502: 00000100:00100000:0.0:1789264124.940607:0:10057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264124.940623:0:10057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae144d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.940741:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322704896 00000100:00100000:3.0:1789264124.940765:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322704896 00000100:00100000:3.0:1789264124.940809:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789264124.940819:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:10057:x1876179322704896:12345-0@lo:502: 00000100:00100000:3.0:1789264124.940927:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:10057:x1876179322704896:12345-0@lo:502: Request processed in 110us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.940934:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789264124.940964:0:10057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10057:1876179322704896:0@lo:502: 00000040:00080000:0.0:1789264124.940987:0:10057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789264124.944286:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789264124.944324:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789264124.944335:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.944347:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264124.944359:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789264124.944362:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789264124.944365:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789264124.944405:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.944423:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.944435:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264124.944458:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322705024:0@lo:101: 00000100:00100000:2.0:1789264124.944522:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.944569:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab26229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264124.944593:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322705024 00000100:00100000:1.0:1789264124.944601:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322705024 00000100:00100000:1.0:1789264124.944653:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789264124.944662:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322705024:12345-0@lo:101: 00010000:00010000:1.0:1789264124.944675:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264124.944688:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed6af8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6af1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.944709:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed6af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6af1 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.944719:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed6af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6af1 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.944727:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f095400, rc 0) 00000100:00100000:1.0:1789264124.944792:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322705024:12345-0@lo:101: Request processed in 131us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264124.944799:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789264124.944818:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322705024:0@lo:101: 00010000:00010000:0.0:1789264124.944834:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264124.944843:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264124.944901:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322705152:0@lo:501: 00000100:00100000:0.0:1789264124.944928:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264124.944959:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae144d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.945017:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322705152 00000100:00100000:3.0:1789264124.945022:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322705152 00000100:00100000:3.0:1789264124.945058:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789264124.945067:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322705152:12345-0@lo:501: 00000100:00100000:3.0:1789264124.945174:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322705152:12345-0@lo:501: Request processed in 108us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.945180:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789264124.945245:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322705152:0@lo:501: 00000100:00100000:0.0:1789264124.945268:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322705280:0@lo:503: 00000100:00100000:0.0:1789264124.945306:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264124.945326:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae144d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789264124.945366:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322705280 00000100:00100000:2.0:1789264124.945374:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322705280 00000100:00100000:2.0:1789264124.945401:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789264124.945408:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322705280:12345-0@lo:503: 00000100:00100000:2.0:1789264124.945571:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322705280:12345-0@lo:503: Request processed in 162us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.945578:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789264124.950730:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322705280:0@lo:503: 00000100:00100000:1.0:1789264124.951963:0:10058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983111f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10058:1876179322705408:0@lo:502: 00000100:00100000:1.0:1789264124.952117:0:10058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.952164:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322705408 00000100:00100000:2.0:1789264124.952172:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322705408 00000100:00100000:1.0:1789264124.952172:0:10058:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264124.952235:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789264124.952244:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:10058:x1876179322705408:12345-0@lo:502: 00000100:00100000:2.0:1789264124.952368:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:10058:x1876179322705408:12345-0@lo:502: Request processed in 124us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.952375:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789264124.954623:0:10058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983111f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10058:1876179322705408:0@lo:502: 00000020:01000000:1.0:1789264124.954676:0:10058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789264124.954687:0:10058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264124.954689:0:10058:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789264124.954695:0:10058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789264124.954697:0:10058:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789264124.954725:0:10058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983111f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10058:1876179322705536:0@lo:502: 00000100:00100000:1.0:1789264124.954826:0:10058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264124.954855:0:10058:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.954923:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322705536 00000100:00100000:3.0:1789264124.954930:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322705536 00000100:00100000:3.0:1789264124.954984:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789264124.954995:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:10058:x1876179322705536:12345-0@lo:502: 00000100:00100000:3.0:1789264124.955112:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:10058:x1876179322705536:12345-0@lo:502: Request processed in 119us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.955120:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789264124.955520:0:10058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983111f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10058:1876179322705536:0@lo:502: 00000020:01000000:1.0:1789264124.955542:0:10058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264124.955547:0:10058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264124.955548:0:10058:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789264124.955553:0:10058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789264124.955700:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789264124.955723:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789264124.955738:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264124.955784:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264124.955794:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789264124.955797:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3aae2b1800 from 39 10000000:01000000:0.0:1789264124.955799:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789264124.955824:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264124.955832:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264124.955841:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264124.955856:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322705664:0@lo:101: 00000100:00100000:0.0:1789264124.955889:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264124.955917:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae144d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789264124.955988:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322705664 00000100:00100000:2.0:1789264124.955993:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322705664 00000100:00100000:2.0:1789264124.956022:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789264124.956029:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322705664:12345-0@lo:101: 00010000:00010000:2.0:1789264124.956038:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264124.956050:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6b06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6aff expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.956071:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6aff expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.956082:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6aff expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.956091:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622000, rc 0) 00000100:00100000:2.0:1789264124.956127:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322705664:12345-0@lo:101: Request processed in 98us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.956140:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789264124.956218:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322705664:0@lo:101: 00010000:00010000:0.0:1789264124.956231:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264124.956240:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264124.956285:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322705792:0@lo:501: 00000100:00100000:0.0:1789264124.956319:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264124.956345:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae144d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789264124.956420:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322705792 00000100:00100000:2.0:1789264124.956427:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322705792 00000100:00100000:2.0:1789264124.956450:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789264124.956456:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322705792:12345-0@lo:501: 00000100:00100000:2.0:1789264124.956541:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322705792:12345-0@lo:501: Request processed in 84us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.956547:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789264124.956703:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322705792:0@lo:501: 00000100:00100000:0.0:1789264124.956729:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322705920:0@lo:503: 00000100:00100000:0.0:1789264124.956792:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264124.956816:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae144d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.956829:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322705920 00000100:00100000:3.0:1789264124.956834:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322705920 00000100:00100000:3.0:1789264124.956871:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789264124.956881:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322705920:12345-0@lo:503: 00000100:00100000:3.0:1789264124.957004:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322705920:12345-0@lo:503: Request processed in 125us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.957012:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789264124.957016:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322705920:0@lo:503: 00000100:00100000:1.0:1789264124.961698:0:10059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983111f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10059:1876179322706048:0@lo:502: 00000100:00100000:1.0:1789264124.961812:0:10059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264124.961850:0:10059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789264124.961913:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322706048 00000100:00100000:2.0:1789264124.961921:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322706048 00000100:00100000:2.0:1789264124.961968:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789264124.961977:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:10059:x1876179322706048:12345-0@lo:502: 00000100:00100000:2.0:1789264124.962090:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:10059:x1876179322706048:12345-0@lo:502: Request processed in 113us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.962098:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789264124.962173:0:10059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983111f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10059:1876179322706048:0@lo:502: 00000100:00100000:1.0:1789264124.962229:0:10059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983111f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10059:1876179322706176:0@lo:502: 00000100:00100000:1.0:1789264124.962261:0:10059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264124.962289:0:10059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789264124.962334:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322706176 00000100:00100000:0.0:1789264124.962340:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322706176 00000100:00100000:0.0:1789264124.962372:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789264124.962379:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:10059:x1876179322706176:12345-0@lo:502: 00000100:00100000:0.0:1789264124.962471:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:10059:x1876179322706176:12345-0@lo:502: Request processed in 92us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264124.962477:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789264124.962589:0:10059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983111f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10059:1876179322706176:0@lo:502: 00000040:00080000:1.0:1789264124.962607:0:10059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789264124.962864:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789264124.962883:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789264124.962893:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264124.962905:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264124.962914:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789264124.962917:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c3aae2b1800 from 6 10000000:01000000:0.0:1789264124.962919:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789264124.962945:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264124.962952:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264124.962970:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264124.962983:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322706304:0@lo:101: 00000100:00100000:0.0:1789264124.963009:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264124.963038:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae144600 going to sleep for 11 seconds 00000100:00100000:1.0:1789264124.963076:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322706304 00000100:00100000:1.0:1789264124.963081:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322706304 00000100:00100000:1.0:1789264124.963113:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789264124.963120:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322706304:12345-0@lo:101: 00010000:00010000:1.0:1789264124.963134:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264124.963146:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f095800/0xecaf9f2f14ed6b14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6b0d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.963165:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f095800/0xecaf9f2f14ed6b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b0d expref: 19 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.963175:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f095800/0xecaf9f2f14ed6b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b0d expref: 19 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.963183:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f095800, rc 0) 00000100:00100000:1.0:1789264124.963221:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:6487:x1876179322706304:12345-0@lo:101: Request processed in 101us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264124.963227:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789264124.963870:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322706304:0@lo:101: 00010000:00010000:0.0:1789264124.963885:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264124.963894:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264124.963940:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322706432:0@lo:256: 00000100:00100000:0.0:1789264124.963976:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264124.964004:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae144600 going to sleep for 11 seconds 00000100:00100000:1.0:1789264124.964039:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322706432 00000100:00100000:1.0:1789264124.964044:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322706432 00000100:00100000:1.0:1789264124.964073:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789264124.964080:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:6487:x1876179322706432:12345-0@lo:256: 20000000:01000000:1.0:1789264124.964093:0:6485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789264124.964110:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789264124.964113:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789264124.964191:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:6487:x1876179322706432:12345-0@lo:256: Request processed in 111us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264124.964207:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789264124.964265:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322706432:0@lo:256: 10000000:01000000:2.0:1789264124.964308:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789264124.964314:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.964322:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264124.964329:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789264124.964331:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1789264124.964339:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789264124.964358:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.964365:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.964373:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264124.964385:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322706560:0@lo:101: 00000100:00100000:2.0:1789264124.964423:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.964443:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8b8f9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789264124.964534:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322706560 00000100:00100000:1.0:1789264124.964539:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322706560 00000100:00100000:1.0:1789264124.964557:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789264124.964564:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:6487:x1876179322706560:12345-0@lo:101: 00010000:00010000:1.0:1789264124.964571:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264124.964587:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f094800/0xecaf9f2f14ed6b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6b1b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.964602:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f094800/0xecaf9f2f14ed6b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b1b expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.964610:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f094800/0xecaf9f2f14ed6b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b1b expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.964618:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f094800, rc 0) 00000100:00100000:1.0:1789264124.964654:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322706560:12345-0@lo:101: Request processed in 90us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264124.964660:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789264124.964771:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322706560:0@lo:101: 00010000:00010000:2.0:1789264124.964783:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b22 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.964791:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6b22 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264124.964838:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322706688:0@lo:501: 00000100:00100000:2.0:1789264124.964863:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.964882:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8b8f9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789264124.964931:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322706688 00000100:00100000:1.0:1789264124.964936:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322706688 00000100:00100000:1.0:1789264124.964959:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789264124.964965:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322706688:12345-0@lo:501: 00000100:00100000:1.0:1789264124.965070:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322706688:12345-0@lo:501: Request processed in 104us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264124.965076:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789264124.965189:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322706688:0@lo:501: 00000100:00100000:2.0:1789264124.965222:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322706816:0@lo:503: 00000100:00100000:2.0:1789264124.965258:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.965304:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8b8f9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789264124.968392:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322706816 00000100:00100000:1.0:1789264124.968407:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322706816 00000100:00100000:1.0:1789264124.968528:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789264124.968539:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322706816:12345-0@lo:503: 00000100:00100000:1.0:1789264124.968909:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322706816:12345-0@lo:503: Request processed in 371us (3649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264124.968917:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789264124.969101:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322706816:0@lo:503: 00000100:00100000:2.0:1789264124.969721:0:10060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10060:1876179322706944:0@lo:502: 00000100:00100000:2.0:1789264124.971721:0:10060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.971780:0:10060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8b8f9900 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.971998:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322706944 00000100:00100000:3.0:1789264124.972006:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322706944 00000100:00100000:3.0:1789264124.972060:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789264124.972083:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:10060:x1876179322706944:12345-0@lo:502: 00000100:00100000:3.0:1789264124.972221:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:10060:x1876179322706944:12345-0@lo:502: Request processed in 141us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.972229:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789264124.972319:0:10060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10060:1876179322706944:0@lo:502: 00000020:01000000:2.0:1789264124.972352:0:10060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789264124.972359:0:10060:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789264124.972366:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264124.972369:0:10060:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789264124.972373:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789264124.972377:0:10060:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:2.0:1789264124.972400:0:10060:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789264124.972403:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789264124.972416:0:10060:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c3ab6923370) 00000020:00000080:2.0:1789264124.972439:0:10060:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1789264124.972445:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789264124.972529:0:10060:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789264124.972536:0:10060:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789264124.972542:0:10060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xecaf9f2f14ed6b30 00010000:00080000:2.0:1789264124.972569:0:10060:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c39833d7000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:2.0:1789264124.972942:0:10060:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1789264124.973068:0:10060:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789264124.973080:0:10060:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789264124.973253:0:10060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789264124.973371:0:10060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789264124.973494:0:10060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789264124.973598:0:10060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000020:00000080:3.0:1789264124.976323:0:10060:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789264124.976337:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789264124.976374:0:10060:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789264124.976398:0:10060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xecaf9f2f14ed6b37 00000100:00080000:3.0:1789264124.976409:0:10060:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789264124.976414:0:10060:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c39833d7000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1789264124.976447:0:10060:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3abf56c380 x1876179322707072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789264124.976508:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322707072:0@lo:8: 00000100:00100000:0.0:1789264124.976573:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789264124.976677:0:10061:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789264124.976682:0:10061:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00080000:3.0:1789264124.976733:0:10060:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789264124.976822:0:10060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264124.976826:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264124.976828:0:10060:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789264124.976831:0:10060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264124.976835:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264124.976836:0:10060:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789264124.976839:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789264124.976841:0:10060:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789264124.976865:0:10060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10060:1876179322707200:0@lo:502: 00000100:00100000:3.0:1789264124.976906:0:10060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264124.976930:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322707200 00000100:00100000:3.0:1789264124.976936:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322707200 00000100:00100000:3.0:1789264124.976971:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789264124.976982:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:10060:x1876179322707200:12345-0@lo:502: 00000100:00100000:3.0:1789264124.977073:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:10060:x1876179322707200:12345-0@lo:502: Request processed in 92us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.977086:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789264124.977121:0:10060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.977137:0:10060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10060:1876179322707200:0@lo:502: 00000020:01000000:3.0:1789264124.977157:0:10060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264124.977160:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264124.977162:0:10060:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789264124.977166:0:10060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1789264124.977222:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1789264124.977241:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789264124.977251:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b22 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.977262:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b22 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264124.977272:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789264124.977275:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3a89eb9800 from 39 10000000:01000000:3.0:1789264124.977278:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789264124.977298:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.977306:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.977315:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264124.977325:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322707328:0@lo:101: 00000100:00100000:3.0:1789264124.977352:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264124.977374:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.977389:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322707328 00000100:00100000:3.0:1789264124.977393:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322707328 00000100:00100000:3.0:1789264124.977418:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789264124.977426:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322707328:12345-0@lo:101: 00010000:00010000:3.0:1789264124.977434:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264124.977445:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6b45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6b3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.977464:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b3e expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.977473:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b3e expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.977482:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36ba00, rc 0) 00000100:00100000:3.0:1789264124.977507:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322707328:12345-0@lo:101: Request processed in 83us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.977513:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789264124.977541:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322707328:0@lo:101: 00010000:00010000:3.0:1789264124.977552:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b45 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.977561:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6b45 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264124.977600:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322707456:0@lo:501: 00000100:00100000:3.0:1789264124.977625:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264124.977638:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.977655:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322707456 00000100:00100000:3.0:1789264124.977658:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322707456 00000100:00100000:3.0:1789264124.977681:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789264124.977689:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322707456:12345-0@lo:501: 00000100:00100000:3.0:1789264124.977803:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322707456:12345-0@lo:501: Request processed in 114us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.977809:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789264124.977839:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322707456:0@lo:501: 00000100:00100000:3.0:1789264124.977861:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322707584:0@lo:503: 00000100:00100000:3.0:1789264124.977893:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264124.977906:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.977918:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322707584 00000100:00100000:3.0:1789264124.977922:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322707584 00000100:00100000:3.0:1789264124.977943:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789264124.977949:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322707584:12345-0@lo:503: 00000100:00100000:3.0:1789264124.978014:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322707584:12345-0@lo:503: Request processed in 65us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.978021:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789264124.978057:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322707584:0@lo:503: 00000100:00100000:3.0:1789264124.978304:0:10063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10063:1876179322707712:0@lo:502: 00000100:00100000:3.0:1789264124.978336:0:10063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264124.978354:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322707712 00000100:00100000:3.0:1789264124.978357:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322707712 00000100:00100000:3.0:1789264124.978376:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789264124.978382:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:10063:x1876179322707712:12345-0@lo:502: 00000100:00100000:3.0:1789264124.978446:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:10063:x1876179322707712:12345-0@lo:502: Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.978458:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789264124.978486:0:10063:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.978498:0:10063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10063:1876179322707712:0@lo:502: 00000100:00100000:3.0:1789264124.978532:0:10063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10063:1876179322707840:0@lo:502: 00000100:00100000:3.0:1789264124.978563:0:10063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264124.978581:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322707840 00000100:00100000:3.0:1789264124.978584:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322707840 00000100:00100000:3.0:1789264124.978606:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789264124.978613:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:10063:x1876179322707840:12345-0@lo:502: 00000100:00100000:2.0:1789264124.981232:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322707968:0@lo:400: 00000100:00100000:2.0:1789264124.981305:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.981338:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322708480:0@lo:400: 00000100:00100000:2.0:1789264124.981363:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.981380:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322708992:0@lo:400: 00000100:00100000:2.0:1789264124.981401:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.981424:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789264124.981429:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322708352:0@lo:400: 00000100:00100000:2.0:1789264124.981454:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.981471:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322708864:0@lo:400: 00000100:00100000:2.0:1789264124.981496:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.981525:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322708224:0@lo:400: 00000100:00100000:2.0:1789264124.981546:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.981563:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322708736:0@lo:400: 00000100:00100000:2.0:1789264124.981583:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.981600:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789264124.981605:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322708096:0@lo:400: 00000100:00100000:2.0:1789264124.981626:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.981661:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322708608:0@lo:400: 00000100:00100000:2.0:1789264124.981682:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.981698:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1876179322709120:0@lo:400: 00000100:00100000:2.0:1789264124.981718:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.981740:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322707968 00000100:00100000:2.0:1789264124.981778:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322707968 00000100:00100000:2.0:1789264124.981811:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322708480 00000100:00100000:2.0:1789264124.981815:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322708480 00000100:00100000:2.0:1789264124.981838:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322708992 00000100:00100000:2.0:1789264124.981847:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322708992 00000100:00100000:2.0:1789264124.981869:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322708224 00000100:00100000:2.0:1789264124.981872:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322708224 00000100:00100000:2.0:1789264124.981882:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322708608 00000100:00100000:2.0:1789264124.981884:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322708608 00000100:00100000:2.0:1789264124.981895:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322709120 00000100:00100000:2.0:1789264124.981899:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322709120 00000100:00100000:2.0:1789264124.981915:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789264124.981924:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322707968:12345-0@lo:400: 00000100:00100000:2.0:1789264124.981972:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322707968:12345-0@lo:400: Request processed in 49us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.981980:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789264124.981995:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789264124.982002:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322708480:12345-0@lo:400: 00000100:00100000:2.0:1789264124.982029:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322708480:12345-0@lo:400: Request processed in 28us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.982035:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789264124.982046:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789264124.982052:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322708992:12345-0@lo:400: 00000100:00100000:2.0:1789264124.982093:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322708992:12345-0@lo:400: Request processed in 41us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.982099:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789264124.982110:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789264124.982116:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322708224:12345-0@lo:400: 00000100:00100000:2.0:1789264124.982146:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322708224:12345-0@lo:400: Request processed in 30us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.982153:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789264124.982164:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789264124.982176:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322708608:12345-0@lo:400: 00000100:00100000:2.0:1789264124.982214:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322708608:12345-0@lo:400: Request processed in 38us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.982219:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789264124.982230:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789264124.982236:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876179322709120:12345-0@lo:400: 00000100:00100000:2.0:1789264124.982259:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876179322709120:12345-0@lo:400: Request processed in 23us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.982264:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789264124.982289:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322708352 00000100:00100000:2.0:1789264124.982293:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322708352 00000100:00100000:2.0:1789264124.982315:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322708096 00000100:00100000:2.0:1789264124.982317:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322708096 00000100:00100000:2.0:1789264124.982327:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789264124.982332:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322708352:12345-0@lo:400: 00000100:00100000:2.0:1789264124.982360:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322708352:12345-0@lo:400: Request processed in 27us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.982366:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789264124.982376:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789264124.982382:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322708096:12345-0@lo:400: 00000100:00100000:2.0:1789264124.982407:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322708096:12345-0@lo:400: Request processed in 25us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.982413:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789264124.982429:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322707072 00000100:00100000:2.0:1789264124.982432:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322707072 00000100:00100000:2.0:1789264124.982444:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322708864 00000100:00100000:2.0:1789264124.982446:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322708864 00000100:00100000:2.0:1789264124.982468:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322708736 00000100:00100000:2.0:1789264124.982471:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322708736 00000100:00100000:2.0:1789264124.982486:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789264124.982491:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322708864:12345-0@lo:400: 00000100:00100000:2.0:1789264124.982520:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322708864:12345-0@lo:400: Request processed in 29us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.982526:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789264124.982536:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789264124.982542:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322708736:12345-0@lo:400: 00000100:00100000:2.0:1789264124.982565:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322708736:12345-0@lo:400: Request processed in 24us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.982571:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789264124.982581:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789264124.982586:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3621:x1876179322707072:12345-0@lo:8: 00010000:00080000:2.0:1789264124.982610:0:8403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1789264124.982640:0:8403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xecaf9f2f14ed6b4c 00002000:00100000:2.0:1789264124.982653:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c3abaff1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789264124.982657:0:8403:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1789264124.982660:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789264124.982714:0:8403:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789264124.982952:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789264124.982976:0:8403:0:(import.c:65:import_set_state_nolock()) ffff9c3abaff2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789264124.983843:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:10063:x1876179322707840:12345-0@lo:502: Request processed in 5227us (5275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.983853:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789264124.984099:0:10063:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.984122:0:10063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10063:1876179322707840:0@lo:502: 00000040:00080000:3.0:1789264124.984155:0:10063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:2.0:1789264124.984339:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3621:x1876179322707072:12345-0@lo:8: Request processed in 1750us (7764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.984347:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789264124.984383:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789264124.984388:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789264124.984400:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264124.984425:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322708096:0@lo:400: 00010000:00080000:2.0:1789264124.984441:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abad81c00 x1876179322708608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264124.984453:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322708608:0@lo:400: 00010000:00080000:2.0:1789264124.984464:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abad83480 x1876179322709120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264124.984473:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1876179322709120:0@lo:400: 00010000:00080000:2.0:1789264124.984485:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abad80e00 x1876179322708224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264124.984493:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322708224:0@lo:400: 00010000:00080000:2.0:1789264124.984503:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abad82680 x1876179322708736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264124.984511:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322708736:0@lo:400: 00000100:00100000:2.0:1789264124.984549:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322708352:0@lo:400: 00010000:00080000:2.0:1789264124.984561:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abad82d80 x1876179322708864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264124.984569:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322708864:0@lo:400: 00010000:00080000:2.0:1789264124.984580:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abad81f80 x1876179322707968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264124.984587:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322707968:0@lo:400: 00010000:00080000:2.0:1789264124.984597:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abad80700 x1876179322708480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264124.984612:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322708480:0@lo:400: 00010000:00080000:2.0:1789264124.984625:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abad82300 x1876179322708992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264124.984645:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322708992:0@lo:400: 00000020:01000000:1.0:1789264124.984776:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789264124.984799:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789264124.984815:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b45 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.984825:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b45 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264124.984835:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789264124.984837:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c3a89eb9800 from 6 10000000:01000000:1.0:1789264124.984840:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789264124.984868:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.984876:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264124.984885:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264124.984904:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983111f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322709248:0@lo:101: 00000100:00100000:1.0:1789264124.984944:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264124.984971:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.985126:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322709248 00000100:00100000:3.0:1789264124.985131:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322709248 00000100:00100000:3.0:1789264124.985171:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789264124.985181:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322709248:12345-0@lo:101: 00010000:00010000:3.0:1789264124.985192:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264124.985214:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6b5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6b53 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.985236:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b53 expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.985258:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b53 expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.985267:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36ae00, rc 0) 00000100:00100000:3.0:1789264124.985309:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322709248:12345-0@lo:101: Request processed in 130us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.985315:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789264124.985380:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983111f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322709248:0@lo:101: 00010000:00010000:2.0:1789264124.985392:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.985401:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264124.985443:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322709376:0@lo:256: 00000100:00100000:2.0:1789264124.985474:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.985496:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a906b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.985540:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322709376 00000100:00100000:3.0:1789264124.985544:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322709376 00000100:00100000:3.0:1789264124.985572:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789264124.985580:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322709376:12345-0@lo:256: 20000000:01000000:3.0:1789264124.985592:0:6485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789264124.985607:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789264124.985611:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789264124.985690:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322709376:12345-0@lo:256: Request processed in 110us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.985696:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789264124.985724:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322709376:0@lo:256: 10000000:01000000:3.0:1789264124.985784:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789264124.985791:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.985798:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264124.985806:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789264124.985808:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789264124.985816:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789264124.985831:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.985838:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.985845:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264124.985856:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322709504:0@lo:101: 00000100:00100000:3.0:1789264124.985880:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264124.985894:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.985906:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322709504 00000100:00100000:3.0:1789264124.985909:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322709504 00000100:00100000:3.0:1789264124.985928:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789264124.985934:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322709504:12345-0@lo:101: 00010000:00010000:3.0:1789264124.985940:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264124.985947:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6b68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6b61 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.985960:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b61 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.985969:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b61 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.985976:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36ac00, rc 0) 00000100:00100000:3.0:1789264124.986002:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322709504:12345-0@lo:101: Request processed in 68us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.986015:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789264124.986044:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322709504:0@lo:101: 00010000:00010000:3.0:1789264124.986054:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b68 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.986063:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6b68 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264124.986105:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322709632:0@lo:501: 00000100:00100000:3.0:1789264124.986129:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264124.986142:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.986152:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322709632 00000100:00100000:3.0:1789264124.986155:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322709632 00000100:00100000:3.0:1789264124.986173:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789264124.986180:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322709632:12345-0@lo:501: 00000100:00100000:3.0:1789264124.986293:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322709632:12345-0@lo:501: Request processed in 113us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.986299:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789264124.986326:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322709632:0@lo:501: 00000100:00100000:3.0:1789264124.986350:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322709760:0@lo:503: 00000100:00100000:3.0:1789264124.986387:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264124.986400:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab09480 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.986410:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322709760 00000100:00100000:3.0:1789264124.986414:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322709760 00000100:00100000:3.0:1789264124.986431:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789264124.986438:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322709760:12345-0@lo:503: 00000100:00100000:3.0:1789264124.986515:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322709760:12345-0@lo:503: Request processed in 78us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.986521:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789264124.986555:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322709760:0@lo:503: 00000100:00100000:3.0:1789264124.986716:0:10064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10064:1876179322709888:0@lo:502: 00000100:00100000:3.0:1789264124.986767:0:10064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264124.986785:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322709888 00000100:00100000:3.0:1789264124.986789:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322709888 00000100:00100000:3.0:1789264124.986807:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789264124.986814:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:10064:x1876179322709888:12345-0@lo:502: 00000100:00100000:3.0:1789264124.986882:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:10064:x1876179322709888:12345-0@lo:502: Request processed in 69us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.986889:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789264124.986915:0:10064:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab09b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.986926:0:10064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10064:1876179322709888:0@lo:502: 00000020:01000000:3.0:1789264124.986945:0:10064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789264124.986951:0:10064:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789264124.986958:0:10064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264124.986960:0:10064:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789264124.986968:0:10064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789264124.986972:0:10064:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:3.0:1789264124.986993:0:10064:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789264124.986996:0:10064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789264124.987009:0:10064:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c3aba8e99b8) 00000020:00000080:3.0:1789264124.987029:0:10064:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789264124.987034:0:10064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789264124.987112:0:10064:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789264124.987118:0:10064:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789264124.987125:0:10064:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed6b76 00010000:00080000:3.0:1789264124.987151:0:10064:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c39833d4000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:3.0:1789264124.987375:0:10064:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1789264124.987481:0:10064:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789264124.987491:0:10064:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789264124.987623:0:10064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789264124.987739:0:10064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789264124.987878:0:10064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789264124.987952:0:10064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00010000:00080000:0.0:1789264124.988333:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abf56c380 x1876179322707072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789264134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264124.988344:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789264124.988352:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789264124.988360:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789264124.988366:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789264124.988369:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c39833d7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789264124.988434:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789264124.988447:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322707072:0@lo:8: 00000040:00080000:0.0:1789264124.988609:0:10065:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789264124.988613:0:10065:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1789264124.989044:0:10061:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789264124.989096:0:10061:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 205330351082ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789264124.989101:0:10061:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789264124.989196:0:10062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10062:1876179322710016:0@lo:700: 00000100:00100000:2.0:1789264124.989259:0:10062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.989287:0:10062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a906b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.989333:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322710016 00000100:00100000:3.0:1789264124.989338:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322710016 00000100:00100000:3.0:1789264124.989388:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789264124.989397:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10062:x1876179322710016:12345-0@lo:700: 00000100:00100000:3.0:1789264124.989425:0:8413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8413:1876179322710144:0@lo:700: 00000100:00100000:3.0:1789264124.989455:0:8413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264124.989470:0:8413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab09180 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.989487:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322710144 00000100:00100000:3.0:1789264124.989491:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322710144 00000100:00100000:3.0:1789264124.989517:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789264124.989525:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8413:x1876179322710144:12345-0@lo:700: 00000100:00080000:2.0:1789264124.989636:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789264124.991193:0:7421:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000020:00000080:3.0:1789264124.991909:0:10064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789264124.991921:0:10064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789264124.991958:0:10064:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789264124.991982:0:10064:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xecaf9f2f14ed6b7d 00000100:00080000:3.0:1789264124.991992:0:10064:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789264124.992004:0:10064:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c39833d4000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1789264124.992036:0:10064:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3abf56f480 x1876179322710272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789264124.992099:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322710272:0@lo:8: 00000100:00100000:0.0:1789264124.992161:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264124.992246:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322710272 00000100:00100000:1.0:1789264124.992253:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322710272 00000100:00100000:1.0:1789264124.992289:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789264124.992296:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3621:x1876179322710272:12345-0@lo:8: 00010000:00080000:1.0:1789264124.992320:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:1.0:1789264124.992343:0:8405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xecaf9f2f14ed6b84 00002000:00100000:1.0:1789264124.992354:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c39835f3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789264124.992357:0:8405:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789264124.992367:0:8405:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789264124.992431:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789264124.992453:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9c39835f0800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789264124.992567:0:10064:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789264124.992631:0:10064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264124.992637:0:10064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264124.992638:0:10064:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789264124.992642:0:10064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264124.992646:0:10064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264124.992647:0:10064:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789264124.992650:0:10064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789264124.992652:0:10064:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789264124.992676:0:10064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10064:1876179322710400:0@lo:502: 00000100:00100000:3.0:1789264124.992721:0:10064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264124.992764:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322710400 00000100:00100000:3.0:1789264124.992768:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322710400 00000100:00100000:3.0:1789264124.992807:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789264124.992815:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:10064:x1876179322710400:12345-0@lo:502: 00000100:00100000:3.0:1789264124.992908:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:10064:x1876179322710400:12345-0@lo:502: Request processed in 94us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264124.992916:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789264124.992950:0:10064:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab09240 going to sleep for 11 seconds 00000100:00100000:3.0:1789264124.992971:0:10064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10064:1876179322710400:0@lo:502: 00000020:01000000:3.0:1789264124.992993:0:10064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264124.992997:0:10064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264124.992999:0:10064:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789264124.993002:0:10064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1789264124.993052:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1789264124.993071:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789264124.993087:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b68 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.993097:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b68 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264124.993107:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789264124.993109:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c3aaa494d28 from 1 10000000:01000000:3.0:1789264124.993112:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789264124.993148:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.993156:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264124.993166:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264124.993178:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322710528:0@lo:101: 00000100:00100000:3.0:1789264124.993216:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264124.993231:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab09240 going to sleep for 11 seconds 00000100:00100000:2.0:1789264124.993382:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322710528 00000100:00100000:2.0:1789264124.993387:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322710528 00000100:00100000:2.0:1789264124.993419:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789264124.993427:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322710528:12345-0@lo:101: 00010000:00010000:2.0:1789264124.993434:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264124.993445:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6b92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6b8b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.993476:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b8b expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.993487:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b8b expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.993495:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623400, rc 0) 00000100:00100000:2.0:1789264124.993526:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322710528:12345-0@lo:101: Request processed in 101us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264124.993532:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789264124.993563:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322710528:0@lo:101: 00010000:00010000:2.0:1789264124.993573:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.993582:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6b92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264124.993647:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322710656:0@lo:501: 00000100:00100000:2.0:1789264124.993673:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264124.993692:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789264124.993705:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322710656 00000100:00100000:2.0:1789264124.993708:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322710656 00000100:00100000:2.0:1789264124.993725:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789264124.993730:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322710656:12345-0@lo:501: 00000100:00100000:2.0:1789264124.993825:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322710656:12345-0@lo:501: Request processed in 93us (151us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789264124.993840:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789264124.993882:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322710656:0@lo:501: 10000000:01000000:2.0:1789264124.993906:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789264124.993911:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264124.993918:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264124.994232:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1876179322710272:12345-0@lo:8: Request processed in 1935us (2070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264124.994240:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789264124.994314:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abf56f480 x1876179322710272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789264134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264124.994324:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789264124.994330:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789264124.994336:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789264124.994341:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789264124.994344:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c39833d4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789264124.994394:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789264124.994400:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322710272:0@lo:8: 40000000:02000000:2.0:1789264124.995915:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000004:00080000:3.0:1789264124.999342:0:10065:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789264124.999444:0:10065:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 205340699669ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789264124.999453:0:10065:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789264125.000975:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789264125.005904:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8413:x1876179322710144:12345-0@lo:700: Request processed in 16369us (16437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264125.005918:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789264125.005934:0:8413:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abf56c700 x1876179322710144/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789264140 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264125.005950:0:8413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8413:1876179322710144:0@lo:700: 40000000:02000000:0.0:1789264125.005964:0:8413:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:0.0:1789264125.013400:0:10066:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789264125.013432:0:10066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10066:1876179322710912:0@lo:7: 00000100:00100000:0.0:1789264125.013494:0:10066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264125.013521:0:10066:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae144600 going to sleep for 11 seconds 00000100:00100000:2.0:1789264125.013567:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322710912 00000100:00100000:2.0:1789264125.013576:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322710912 00000100:00080000:3.0:1789264125.013623:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789264125.013641:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789264125.013651:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10066:x1876179322710912:12345-0@lo:7: 00000100:00100000:2.0:1789264125.013782:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322710784:0@lo:13: 00000100:00100000:2.0:1789264125.013829:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264125.014239:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322710784 00000100:00100000:3.0:1789264125.014244:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322710784 00000100:00100000:3.0:1789264125.014301:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789264125.014310:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1876179322710784:12345-0@lo:13: 00002000:00000024:3.0:1789264125.014328:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1789264125.014377:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1876179322710784:12345-0@lo:13: Request processed in 70us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264125.014385:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00100000:3.0:1789264125.015418:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789264125.015426:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789264125.015556:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10062:x1876179322710016:12345-0@lo:700: Request processed in 26158us (26293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264125.015567:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789264125.015657:0:10062:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abab42680 x1876179322710016/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789264140 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264125.015672:0:10062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10062:1876179322710016:0@lo:700: 00002000:00080000:2.0:1789264125.026562:0:8406:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789264125.026571:0:8406:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789264125.026685:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10066:x1876179322710912:12345-0@lo:7: Request processed in 13031us (13186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264125.026695:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789264125.026777:0:10066:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3aa98a3480 x1876179322710912/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789264141 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789264125.026787:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abaa90380 x1876179322710784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264125.026810:0:10066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10066:1876179322710912:0@lo:7: 00000100:00100000:2.0:1789264125.026818:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322710784:0@lo:13: 00000004:00080000:1.0:1789264125.026825:0:10066:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789264125.026867:0:10066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983111180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10066:1876179322711040:0@lo:5: 00000100:00100000:1.0:1789264125.026901:0:10066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264125.026945:0:10066:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264125.026968:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322711040 00000100:00100000:2.0:1789264125.026975:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322711040 00000100:00100000:2.0:1789264125.027036:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789264125.027045:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10066:x1876179322711040:12345-0@lo:5: 00002000:00080000:2.0:1789264125.027069:0:8405:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789264125.027073:0:8405:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789264125.027335:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10066:x1876179322711040:12345-0@lo:5: Request processed in 291us (434us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789264125.027342:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789264125.027456:0:10066:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983111180 x1876179322711040/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789264141 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264125.027469:0:10066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983111180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10066:1876179322711040:0@lo:5: 00000004:00080000:1.0:1789264125.027478:0:10066:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789264125.027514:0:10066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983111500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10066:1876179322711168:0@lo:700: 00000100:00100000:1.0:1789264125.027556:0:10066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264125.027589:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322711168 00000100:00100000:1.0:1789264125.027592:0:10066:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264125.027595:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322711168 00000100:00100000:0.0:1789264125.027637:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789264125.027644:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10066:x1876179322711168:12345-0@lo:700: 00000004:00080000:3.0:1789264125.032839:0:10062:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789264125.032843:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789264125.032867:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322711296:0@lo:13: 00000100:00100000:3.0:1789264125.032873:0:10062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10062:1876179322711424:0@lo:7: 00000100:00100000:3.0:1789264125.032953:0:10062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264125.032954:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1789264125.034475:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1789264125.035559:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322711296 00000100:00100000:2.0:1789264125.035570:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322711296 00000100:00100000:2.0:1789264125.035842:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789264125.035855:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322711296:12345-0@lo:13: 00002000:00000024:2.0:1789264125.035880:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789264125.035944:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322711296:12345-0@lo:13: Request processed in 92us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264125.035951:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789264125.036334:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10066:x1876179322711168:12345-0@lo:700: Request processed in 8688us (8779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264125.036343:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789264125.036396:0:10066:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983111500 x1876179322711168/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789264141 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264125.036431:0:10066:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789264125.036449:0:10066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983111500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10066:1876179322711168:0@lo:700: 00010000:00080000:2.0:1789264125.037272:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abf56ea00 x1876179322711296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264125.037292:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322711296:0@lo:13: 00000100:00100000:2.0:1789264125.037372:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322711424 00000100:00100000:2.0:1789264125.037378:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322711424 00000100:00100000:2.0:1789264125.037413:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789264125.037421:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10062:x1876179322711424:12345-0@lo:7: 00000004:02000040:1.0:1789264125.037591:0:10066:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1789264125.038086:0:10062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab09480 going to sleep for 11 seconds 00002000:00080000:2.0:1789264125.042145:0:8403:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789264125.042154:0:8403:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789264125.042264:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10062:x1876179322711424:12345-0@lo:7: Request processed in 4839us (9311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264125.042277:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789264125.042350:0:10062:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abf56d180 x1876179322711424/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789264141 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264125.043014:0:10062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10062:1876179322711424:0@lo:7: 00000004:00080000:3.0:1789264125.043029:0:10062:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789264125.043436:0:10062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10062:1876179322711552:0@lo:5: 00000100:00100000:2.0:1789264125.043476:0:10062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264125.043595:0:10062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab686ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789264125.044726:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322711552 00000100:00100000:0.0:1789264125.044738:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322711552 00000100:00100000:0.0:1789264125.044808:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789264125.044817:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10062:x1876179322711552:12345-0@lo:5: 00002000:00080000:0.0:1789264125.044846:0:8405:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789264125.044906:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10062:x1876179322711552:12345-0@lo:5: Request processed in 90us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264125.044913:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789264125.046326:0:10062:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abab42680 x1876179322711552/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789264141 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264125.046344:0:10062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10062:1876179322711552:0@lo:5: 00000004:00080000:2.0:1789264125.046359:0:10062:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789264125.046408:0:10062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10062:1876179322711680:0@lo:5: 00000100:00100000:2.0:1789264125.046468:0:10062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264125.046509:0:10062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab686ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789264125.046793:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322711680 00000100:00100000:0.0:1789264125.046799:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322711680 00000100:00100000:0.0:1789264125.046859:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789264125.046869:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10062:x1876179322711680:12345-0@lo:5: 00002000:00080000:0.0:1789264125.046904:0:8403:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1789264125.048703:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:10062:x1876179322711680:12345-0@lo:5: Request processed in 1831us (2229us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789264125.048714:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789264125.048828:0:10062:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abab42680 x1876179322711680/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789264141 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264125.048846:0:10062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10062:1876179322711680:0@lo:5: 00000004:00080000:2.0:1789264125.048858:0:10062:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789264125.048897:0:10062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad82300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10062:1876179322711808:0@lo:900: 00000100:00100000:2.0:1789264125.048933:0:10062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264125.048960:0:10062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab686ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789264125.049008:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322711808 00000100:00100000:0.0:1789264125.049014:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322711808 00000100:00100000:0.0:1789264125.049156:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789264125.049166:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10062:x1876179322711808:12345-0@lo:900: 00000100:00100000:0.0:1789264125.049236:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10062:x1876179322711808:12345-0@lo:900: Request processed in 72us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264125.049243:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789264125.049305:0:10062:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abad82300 x1876179322711808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789264141 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264125.049316:0:10062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad82300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10062:1876179322711808:0@lo:900: 00000100:00100000:1.0:1789264125.051610:0:10066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983111500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10066:1876179322711936:0@lo:5: 00000100:00100000:1.0:1789264125.051670:0:10066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264125.051702:0:10066:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264125.053216:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322711936 00000100:00100000:2.0:1789264125.053228:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322711936 00000100:00100000:2.0:1789264125.053278:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789264125.053288:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10066:x1876179322711936:12345-0@lo:5: 00002000:00080000:2.0:1789264125.064558:0:8406:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789264125.064587:0:8406:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1789264125.068841:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10066:x1876179322711936:12345-0@lo:5: Request processed in 15547us (17163us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789264125.068932:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789264125.068989:0:10066:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983111500 x1876179322711936/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789264141 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264125.069006:0:10066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983111500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10066:1876179322711936:0@lo:5: 00000004:00080000:1.0:1789264125.069021:0:10066:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:2.0:1789264125.450279:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322712064:0@lo:41: 00000100:00100000:2.0:1789264125.450617:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264125.450770:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322712064 00000100:00100000:3.0:1789264125.450778:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322712064 00000100:00100000:3.0:1789264125.450840:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789264125.450864:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322712064:12345-0@lo:41: 00000004:00000024:3.0:1789264125.450896:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789264125.450947:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322712064:12345-0@lo:41: Request processed in 86us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264125.450955:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789264125.450987:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322712064:0@lo:41: 00010000:00010000:1.0:1789264125.577977:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264126.096024:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264126.096592:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311133056 00000100:00100000:2.0:1789264126.096603:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311133056 00000100:00100000:2.0:1789264126.096649:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 174 00000100:00100000:2.0:1789264126.096657:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1876179311133056:12345-192.168.203.44@tcp:250: 00010000:00080000:2.0:1789264126.096682:0:6482:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee@192.168.203.44@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1789264126.096727:0:6482:0:(genops.c:1385:class_connect()) connect: client a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee, cookie 0xecaf9f2f14ed6b99 00000100:00080000:2.0:1789264126.096914:0:6482:0:(import.c:65:import_set_state_nolock()) ffff9c3abf687800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789264126.096982:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+5:2401:x1876179311133056:12345-192.168.203.44@tcp:250: Request processed in 325us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264126.096990:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 174 00000100:00100000:0.0:1789264126.102660:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264126.104105:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311132928 00000100:00100000:1.0:1789264126.104124:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311132928 00000100:00100000:1.0:1789264126.104227:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 175 00000100:00100000:1.0:1789264126.104239:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+5:6152:x1876179311132928:12345-192.168.203.44@tcp:101: 00010000:00010000:1.0:1789264126.104261:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264126.104283:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f094000/0xecaf9f2f14ed6ba0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bda925 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264126.104317:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f094000/0xecaf9f2f14ed6ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda925 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264126.104330:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f094000/0xecaf9f2f14ed6ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda925 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264126.104340:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f094000, rc 0) 00000100:00100000:1.0:1789264126.104973:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+6:6152:x1876179311132928:12345-192.168.203.44@tcp:101: Request processed in 733us (2322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264126.104982:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 175 00000100:00100000:0.0:1789264126.119221:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264126.119334:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311133184 00000100:00100000:3.0:1789264126.119347:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311133184 00000100:00100000:3.0:1789264126.119433:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 176 00000100:00100000:3.0:1789264126.119446:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+6:6152:x1876179311133184:12345-192.168.203.44@tcp:501: 00000100:00100000:3.0:1789264126.119601:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+6:6152:x1876179311133184:12345-192.168.203.44@tcp:501: Request processed in 158us (394us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789264126.119611:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 176 00000100:00100000:0.0:1789264126.123843:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264126.124008:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311133312 00000100:00100000:2.0:1789264126.124021:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311133312 00000100:00100000:2.0:1789264126.124090:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 177 00000100:00100000:2.0:1789264126.124102:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+6:6152:x1876179311133312:12345-192.168.203.44@tcp:101: 00010000:00010000:2.0:1789264126.124122:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264126.124144:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6ba7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bda92c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264126.124180:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda92c expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264126.124205:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda92c expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264126.124236:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623e00, rc 0) 00000100:00100000:2.0:1789264126.124311:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+7:6152:x1876179311133312:12345-192.168.203.44@tcp:101: Request processed in 210us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264126.124318:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 177 00000100:00100000:0.0:1789264126.126552:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264126.126654:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311133440 00000100:00100000:1.0:1789264126.126665:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311133440 00000100:00100000:1.0:1789264126.126727:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 178 00000100:00100000:1.0:1789264126.126738:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+7:6152:x1876179311133440:12345-192.168.203.44@tcp:501: 00000100:00100000:1.0:1789264126.127071:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+8:6152:x1876179311133440:12345-192.168.203.44@tcp:501: Request processed in 333us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264126.127080:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 178 00000100:00100000:0.0:1789264126.128613:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264126.128687:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311133568 00000100:00100000:3.0:1789264126.128697:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311133568 00000100:00100000:3.0:1789264126.128772:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 179 00000100:00100000:3.0:1789264126.128782:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+8:6152:x1876179311133568:12345-192.168.203.44@tcp:503: 00000100:00100000:3.0:1789264126.128942:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+8:6152:x1876179311133568:12345-192.168.203.44@tcp:503: Request processed in 161us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264126.128951:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 179 00000100:00100000:0.0:1789264126.134542:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264126.134669:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311133696 00000100:00100000:2.0:1789264126.134683:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311133696 00000100:00100000:2.0:1789264126.134814:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 180 00000100:00100000:2.0:1789264126.134826:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+8:6171:x1876179311133696:12345-192.168.203.44@tcp:502: 00000100:00100000:2.0:1789264126.135173:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+8:6171:x1876179311133696:12345-192.168.203.44@tcp:502: Request processed in 348us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264126.135183:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 180 00000100:00100000:0.0:1789264126.187904:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264126.188542:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311133824 00000100:00100000:1.0:1789264126.188557:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311133824 00000100:00100000:1.0:1789264126.188689:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 181 00000100:00100000:1.0:1789264126.188703:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+8:6171:x1876179311133824:12345-192.168.203.44@tcp:502: 00000100:00100000:1.0:1789264126.188961:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+8:6171:x1876179311133824:12345-192.168.203.44@tcp:502: Request processed in 260us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264126.188969:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 181 00000100:00100000:0.0:1789264126.191850:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264126.192415:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311133952 00000100:00100000:2.0:1789264126.192429:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311133952 00000100:00100000:2.0:1789264126.192596:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 182 00000100:00100000:2.0:1789264126.192620:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+8:6152:x1876179311133952:12345-192.168.203.44@tcp:101: 00010000:00010000:2.0:1789264126.192641:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264126.192665:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5623a00/0xecaf9f2f14ed6bae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bda95d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264126.192704:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5623a00/0xecaf9f2f14ed6bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda95d expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264126.192718:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5623a00/0xecaf9f2f14ed6bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda95d expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264126.192729:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623a00, rc 0) 00000100:00100000:2.0:1789264126.192849:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6152:x1876179311133952:12345-192.168.203.44@tcp:101: Request processed in 242us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264126.192857:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 182 00000100:00100000:0.0:1789264126.201779:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264126.202412:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311134080 00000100:00100000:1.0:1789264126.202436:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311134080 00000100:00100000:1.0:1789264126.202700:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 183 00000100:00100000:1.0:1789264126.202713:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6152:x1876179311134080:12345-192.168.203.44@tcp:256: 20000000:01000000:1.0:1789264126.202778:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789264126.202809:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789264126.202813:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789264126.202817:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789264126.202820:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789264126.202822:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789264126.210902:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6152:x1876179311134080:12345-192.168.203.44@tcp:256: Request processed in 8173us (9120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264126.210921:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 183 00000100:00100000:0.0:1789264126.216615:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264126.216841:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311134208 00000100:00100000:2.0:1789264126.216855:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311134208 00000100:00100000:2.0:1789264126.216922:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 184 00000100:00100000:2.0:1789264126.216935:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6152:x1876179311134208:12345-192.168.203.44@tcp:101: 00010000:00010000:2.0:1789264126.216955:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264126.216986:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5623000/0xecaf9f2f14ed6bb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bda964 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264126.217022:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5623000/0xecaf9f2f14ed6bb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda964 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264126.217035:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5623000/0xecaf9f2f14ed6bb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda964 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264126.217045:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623000, rc 0) 00000100:00100000:2.0:1789264126.217119:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6152:x1876179311134208:12345-192.168.203.44@tcp:101: Request processed in 187us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264126.217128:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 184 00000100:00100000:2.0:1789264126.228821:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264126.228982:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311134336 00000100:00100000:1.0:1789264126.228995:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311134336 00000100:00100000:1.0:1789264126.229066:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 185 00000100:00100000:1.0:1789264126.229078:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6152:x1876179311134336:12345-192.168.203.44@tcp:501: 00000100:00100000:1.0:1789264126.229282:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6152:x1876179311134336:12345-192.168.203.44@tcp:501: Request processed in 205us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264126.229291:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 185 00000100:00100000:0.0:1789264126.232230:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264126.232339:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311134464 00000100:00100000:3.0:1789264126.232350:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311134464 00000100:00100000:3.0:1789264126.232427:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 186 00000100:00100000:3.0:1789264126.232447:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6152:x1876179311134464:12345-192.168.203.44@tcp:503: 00000100:00100000:3.0:1789264126.232618:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6152:x1876179311134464:12345-192.168.203.44@tcp:503: Request processed in 180us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264126.232626:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 186 00000100:00100000:0.0:1789264126.242669:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264126.242795:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311134592 00000100:00100000:2.0:1789264126.242809:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311134592 00000100:00100000:2.0:1789264126.242875:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 187 00000100:00100000:2.0:1789264126.242887:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6176:x1876179311134592:12345-192.168.203.44@tcp:502: 00000100:00100000:2.0:1789264126.243093:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6176:x1876179311134592:12345-192.168.203.44@tcp:502: Request processed in 207us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264126.243111:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 187 00000100:00100000:2.0:1789264126.248614:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264126.251940:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311134720 00000100:00100000:1.0:1789264126.252021:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311134720 00000100:00100000:1.0:1789264126.252185:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 188 00000100:00100000:1.0:1789264126.252206:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6176:x1876179311134720:12345-192.168.203.44@tcp:502: 00000100:00100000:1.0:1789264126.252426:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6176:x1876179311134720:12345-192.168.203.44@tcp:502: Request processed in 222us (3824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264126.252434:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 188 00000100:00100000:2.0:1789264126.259173:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264126.259271:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264126.263247:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311134848 00000100:00100000:3.0:1789264126.263267:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311134848 00000100:00100000:3.0:1789264126.263325:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311135104 00000100:00100000:3.0:1789264126.263329:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311135104 00000100:00100000:3.0:1789264126.263363:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:3.0:1789264126.263373:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1876179311134848:12345-192.168.203.44@tcp:38: 00010000:00080000:3.0:1789264126.263411:0:6490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:3.0:1789264126.263546:0:6490:0:(genops.c:1385:class_connect()) connect: client 92638a4f-1391-4305-a4ab-5961bcacc46a, cookie 0xecaf9f2f14ed6bbc 00000004:00100000:3.0:1789264126.263578:0:6490:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789264126.264123:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:2.0:1789264126.264131:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1876179311135104:12345-192.168.203.44@tcp:38: 00010000:00080000:2.0:1789264126.264153:0:7904:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1789264126.264202:0:7904:0:(genops.c:1385:class_connect()) connect: client 92638a4f-1391-4305-a4ab-5961bcacc46a, cookie 0xecaf9f2f14ed6bc3 00000004:00100000:2.0:1789264126.264218:0:7904:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789264126.264386:0:6490:0:(import.c:65:import_set_state_nolock()) ffff9c39833d7800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789264126.264425:0:7904:0:(import.c:65:import_set_state_nolock()) ffff9c3abf686800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789264126.264483:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2401:x1876179311135104:12345-192.168.203.44@tcp:38: Request processed in 350us (5211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264126.264491:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:3.0:1789264126.264707:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2401:x1876179311134848:12345-192.168.203.44@tcp:38: Request processed in 1333us (5545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264126.264716:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00010000:00010000:2.0:1789264126.603263:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264127.270796:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264127.270845:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264127.270921:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264127.271113:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311135360 00000100:00100000:1.0:1789264127.271126:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311135360 00000100:00100000:1.0:1789264127.271223:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311135232 00000100:00100000:1.0:1789264127.271227:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311135232 00000100:00100000:1.0:1789264127.271247:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311134976 00000100:00100000:1.0:1789264127.271250:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311134976 00000100:00100000:1.0:1789264127.271268:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:1.0:1789264127.271279:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+7:6152:x1876179311135360:12345-192.168.203.44@tcp:41: 00000004:00000024:1.0:1789264127.271503:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789264127.271584:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+7:6152:x1876179311135360:12345-192.168.203.44@tcp:41: Request processed in 305us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264127.271600:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:1.0:1789264127.271621:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00080000:0.0:1789264127.271712:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789264127.271716:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789264127.271925:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:0.0:1789264127.271939:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+6:0:x1876179311134976:12345-192.168.203.44@tcp:41: 00000004:00000024:0.0:1789264127.271956:0:9197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789264127.271984:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+6:0:x1876179311134976:12345-192.168.203.44@tcp:41: Request processed in 50us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264127.272027:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:0:x1876179311135232:12345-192.168.203.44@tcp:41: 00000004:00000024:1.0:1789264127.272046:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789264127.272076:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:0:x1876179311135232:12345-192.168.203.44@tcp:41: Request processed in 448us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264127.274080:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:1.0:1789264127.274147:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:2.0:1789264127.280464:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264127.280785:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311135488 00000100:00100000:3.0:1789264127.280799:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311135488 00000100:00100000:3.0:1789264127.280888:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:3.0:1789264127.280900:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+6:6152:x1876179311135488:12345-192.168.203.44@tcp:40: 00000100:00100000:3.0:1789264127.281026:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+6:6152:x1876179311135488:12345-192.168.203.44@tcp:40: Request processed in 130us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264127.281036:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:3.0:1789264127.283562:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264127.283687:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311135872 00000100:00100000:2.0:1789264127.283699:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311135872 00000100:00100000:2.0:1789264127.283801:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:2.0:1789264127.283812:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:6152:x1876179311135872:12345-192.168.203.44@tcp:900: 00000100:00100000:2.0:1789264127.283914:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:6152:x1876179311135872:12345-192.168.203.44@tcp:900: Request processed in 104us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264127.283932:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:3.0:1789264127.284319:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264127.284567:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264127.284592:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264127.285138:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311135616 00000100:00100000:0.0:1789264127.285148:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311135616 00000100:00100000:0.0:1789264127.285198:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311135744 00000100:00100000:0.0:1789264127.285218:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311135744 00000100:00100000:0.0:1789264127.285238:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:0.0:1789264127.285245:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1876179311135616:12345-192.168.203.44@tcp:8: 00010000:00080000:0.0:1789264127.285284:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:0.0:1789264127.285333:0:8405:0:(genops.c:1385:class_connect()) connect: client 92638a4f-1391-4305-a4ab-5961bcacc46a, cookie 0xecaf9f2f14ed6bca 00002000:00100000:0.0:1789264127.285349:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 92638a4f-1391-4305-a4ab-5961bcacc46a/ffff9c3abf630800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789264127.285373:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789264127.285876:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789264127.285914:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9c3abf637000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789264127.285981:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2401:x1876179311135616:12345-192.168.203.44@tcp:8: Request processed in 734us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264127.285989:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:0.0:1789264127.286010:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:0.0:1789264127.286015:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1876179311135744:12345-192.168.203.44@tcp:8: 00010000:00080000:0.0:1789264127.286034:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:0.0:1789264127.286050:0:8405:0:(genops.c:1385:class_connect()) connect: client 92638a4f-1391-4305-a4ab-5961bcacc46a, cookie 0xecaf9f2f14ed6bd1 00002000:00100000:0.0:1789264127.286056:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 92638a4f-1391-4305-a4ab-5961bcacc46a/ffff9c3abf630000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789264127.286070:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789264127.286209:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789264127.286224:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9c3abf637800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789264127.286248:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2401:x1876179311135744:12345-192.168.203.44@tcp:8: Request processed in 231us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264127.286254:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:2.0:1789264127.286859:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311136000 00000100:00100000:2.0:1789264127.286867:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311136000 00000100:00100000:2.0:1789264127.286916:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 189 00000100:00100000:2.0:1789264127.286924:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2402:x1876179311136000:12345-192.168.203.44@tcp:400: 00000100:00100000:2.0:1789264127.286974:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2402:x1876179311136000:12345-192.168.203.44@tcp:400: Request processed in 50us (2656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264127.286983:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 189 00000100:00100000:3.0:1789264127.296047:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264127.296193:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311136128 00000100:00100000:1.0:1789264127.296207:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311136128 00000100:00100000:1.0:1789264127.296279:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:1.0:1789264127.296292:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:6152:x1876179311136128:12345-192.168.203.44@tcp:33: 00000004:00080000:2.0:1789264127.312826:0:6493:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 16402us 00000004:00200000:3.0:1789264127.323556:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789264127.323674:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:6152:x1876179311136128:12345-192.168.203.44@tcp:33: Request processed in 27380us (27638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264127.323698:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:1.0:1789264127.473904:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264127.473984:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311136256 00000100:00100000:1.0:1789264127.473993:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311136256 00000100:00100000:1.0:1789264127.474212:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:1.0:1789264127.474224:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:6194:x1876179311136256:12345-192.168.203.44@tcp:101: 00010000:00010000:1.0:1789264127.474244:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264127.474310:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8f094200/0xecaf9f2f14ed6bd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bda995 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264127.474384:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8f094600/0xecaf9f2f14ed6bdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264127.474397:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8f094600/0xecaf9f2f14ed6bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264127.474410:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8f094600/0xecaf9f2f14ed6bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264127.474466:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789264127.474470:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789264127.474484:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8f094600/0xecaf9f2f14ed6bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264127.474508:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8f094200/0xecaf9f2f14ed6bd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda995 expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264127.474527:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8f094600/0xecaf9f2f14ed6bdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda995 expref: 7 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264127.474537:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3a916dc000) 00010000:00010000:1.0:1789264127.474540:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789264127.474543:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f094600, rc 0) 00000100:00100000:1.0:1789264127.474617:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+7:6194:x1876179311136256:12345-192.168.203.44@tcp:101: Request processed in 395us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264127.474624:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:1.0:1789264127.498954:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322712192:0@lo:13: 00000100:00100000:1.0:1789264127.499594:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264127.505936:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789264127.506528:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322712192 00000100:00100000:0.0:1789264127.506539:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322712192 00000100:00100000:0.0:1789264127.506691:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789264127.506704:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322712192:12345-0@lo:13: 00002000:00000024:0.0:1789264127.506727:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789264127.507339:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264127.508558:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322712320:0@lo:13: 00000100:00100000:1.0:1789264127.508624:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264127.508711:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322712192:12345-0@lo:13: Request processed in 2010us (9117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264127.508721:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789264127.508817:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac68700 x1876179322712192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264127.508840:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322712192:0@lo:13: 00000100:00100000:0.0:1789264127.509051:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322712320 00000100:00100000:0.0:1789264127.509058:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322712320 00000100:00100000:0.0:1789264127.509113:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789264127.509122:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322712320:12345-0@lo:13: 00002000:00000024:0.0:1789264127.509142:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789264127.509323:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789264127.509381:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abf56c000 x1876179322712320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264127.509408:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322712320:0@lo:13: 00000100:00100000:0.0:1789264127.509509:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322712320:12345-0@lo:13: Request processed in 60us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264127.509516:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789264127.629146:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264128.009987:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322712448:0@lo:41: 00000100:00100000:1.0:1789264128.010062:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264128.010213:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322712448 00000100:00100000:3.0:1789264128.010222:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322712448 00000100:00100000:3.0:1789264128.010292:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789264128.010303:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322712448:12345-0@lo:41: 00000004:00000024:3.0:1789264128.010336:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789264128.010395:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322712448:12345-0@lo:41: Request processed in 94us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264128.010401:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789264128.010483:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322712448:0@lo:41: 00010000:00010000:1.0:1789264128.649975:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264129.323487:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264129.323659:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311136384 00000100:00100000:1.0:1789264129.323670:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311136384 00000100:00100000:1.0:1789264129.324162:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00100000:1.0:1789264129.324186:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+7:6246:x1876179311136384:12345-192.168.203.44@tcp:41: 00000004:00000024:1.0:1789264129.324223:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789264129.324295:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+7:6246:x1876179311136384:12345-192.168.203.44@tcp:41: Request processed in 124us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264129.324303:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00080000:3.0:1789264129.324697:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789264129.328126:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264129.328447:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311136512 00000100:00100000:0.0:1789264129.328459:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311136512 00000100:00100000:0.0:1789264129.328588:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:0.0:1789264129.328602:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:6246:x1876179311136512:12345-192.168.203.44@tcp:41: 00000004:00000024:0.0:1789264129.328639:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789264129.328718:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:6246:x1876179311136512:12345-192.168.203.44@tcp:41: Request processed in 120us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264129.328725:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00080000:3.0:1789264129.329429:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789264129.332193:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264129.332323:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311136640 00000100:00100000:1.0:1789264129.332333:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311136640 00000100:00100000:1.0:1789264129.332449:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:1.0:1789264129.332460:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:92638a4f-1391-4305-a4ab-5961bcacc46a+6:6246:x1876179311136640:12345-192.168.203.44@tcp:13: 00002000:00000024:1.0:1789264129.332493:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264129.332564:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:92638a4f-1391-4305-a4ab-5961bcacc46a+6:6246:x1876179311136640:12345-192.168.203.44@tcp:13: Request processed in 106us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264129.332572:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00080000:3.0:1789264129.333103:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789264129.335501:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264129.336217:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311136768 00000100:00100000:1.0:1789264129.336228:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311136768 00000100:00100000:1.0:1789264129.336309:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:1.0:1789264129.336319:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:92638a4f-1391-4305-a4ab-5961bcacc46a+6:6246:x1876179311136768:12345-192.168.203.44@tcp:13: 00002000:00000024:1.0:1789264129.336365:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264129.336436:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:92638a4f-1391-4305-a4ab-5961bcacc46a+6:6246:x1876179311136768:12345-192.168.203.44@tcp:13: Request processed in 118us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264129.336445:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00080000:3.0:1789264129.336682:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789264129.674136:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264130.058799:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322712576:0@lo:13: 00000100:00100000:0.0:1789264130.058867:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264130.058918:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322713088:0@lo:400: 00000100:00100000:0.0:1789264130.058963:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264130.058983:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322713600:0@lo:400: 00000100:00100000:0.0:1789264130.059022:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264130.059042:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322714112:0@lo:400: 00000100:00100000:0.0:1789264130.059065:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264130.059092:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789264130.059098:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322712960:0@lo:400: 00000100:00100000:0.0:1789264130.059125:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264130.059148:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1876179322713472:0@lo:400: 00000100:00100000:0.0:1789264130.059185:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264130.059209:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322713984:0@lo:400: 00000100:00100000:0.0:1789264130.059238:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264130.059270:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322712704:0@lo:400: 00000100:00100000:0.0:1789264130.059308:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264130.059343:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322713216:0@lo:400: 00000100:00100000:0.0:1789264130.059365:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264130.059383:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322713728:0@lo:400: 00000100:00100000:0.0:1789264130.059403:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264130.059417:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322714240:0@lo:400: 00000100:00100000:0.0:1789264130.059434:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264130.059447:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789264130.059452:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322712832:0@lo:400: 00000100:00100000:0.0:1789264130.059471:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264130.059485:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322713344:0@lo:400: 00000100:00100000:0.0:1789264130.059500:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264130.059522:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1876179322713856:0@lo:400: 00000100:00100000:0.0:1789264130.059540:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264130.059563:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322712576 00000100:00100000:0.0:1789264130.059570:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322712576 00000100:00100000:2.0:1789264130.059578:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322712704 00000100:00100000:2.0:1789264130.059584:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322712704 00000100:00100000:0.0:1789264130.059626:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789264130.059630:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789264130.059640:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1876179322712576:12345-0@lo:13: 00000100:00100000:2.0:1789264130.059643:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aaa0bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322712704:12345-0@lo:400: 00002000:00000024:0.0:1789264130.059663:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264130.059704:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aaa0bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322712704:12345-0@lo:400: Request processed in 64us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264130.059712:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1876179322712576:12345-0@lo:13: Request processed in 74us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264130.059715:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789264130.059723:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789264130.059771:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322713088 00000100:00100000:0.0:1789264130.059775:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322713088 00000100:00100000:0.0:1789264130.059794:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322713472 00000100:00100000:0.0:1789264130.059797:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322713472 00000100:00100000:0.0:1789264130.059809:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322713984 00000100:00100000:0.0:1789264130.059811:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322713984 00000100:00100000:0.0:1789264130.059820:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322712832 00000100:00100000:0.0:1789264130.059822:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322712832 00000100:00100000:0.0:1789264130.059831:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322713344 00000100:00100000:0.0:1789264130.059833:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322713344 00000100:00100000:0.0:1789264130.059841:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322713856 00000100:00100000:0.0:1789264130.059843:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322713856 00000100:00100000:0.0:1789264130.059853:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789264130.059857:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322713088:12345-0@lo:400: 00000100:00100000:0.0:1789264130.059885:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322713088:12345-0@lo:400: Request processed in 28us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264130.059891:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789264130.059901:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789264130.059906:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1876179322713472:12345-0@lo:400: 00000100:00100000:0.0:1789264130.059941:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1876179322713472:12345-0@lo:400: Request processed in 35us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264130.059947:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789264130.059959:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789264130.059965:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1876179322713984:12345-0@lo:400: 00000100:00100000:0.0:1789264130.059989:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1876179322713984:12345-0@lo:400: Request processed in 25us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264130.059994:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789264130.060005:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789264130.060011:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322712832:12345-0@lo:400: 00000100:00100000:0.0:1789264130.060035:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322712832:12345-0@lo:400: Request processed in 25us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264130.060041:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789264130.060052:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789264130.060057:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876179322713344:12345-0@lo:400: 00000100:00100000:0.0:1789264130.060083:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876179322713344:12345-0@lo:400: Request processed in 26us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264130.060088:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789264130.060099:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789264130.060105:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1876179322713856:12345-0@lo:400: 00000100:00100000:0.0:1789264130.060129:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1876179322713856:12345-0@lo:400: Request processed in 25us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264130.060135:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789264130.060151:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322713600 00000100:00100000:0.0:1789264130.060154:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322713600 00000100:00100000:0.0:1789264130.060182:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322714112 00000100:00100000:0.0:1789264130.060191:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322714112 00000100:00100000:0.0:1789264130.060212:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322713728 00000100:00100000:0.0:1789264130.060214:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322713728 00000100:00100000:0.0:1789264130.060224:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322714240 00000100:00100000:0.0:1789264130.060227:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322714240 00000100:00100000:0.0:1789264130.060237:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789264130.060241:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322713600:12345-0@lo:400: 00000100:00100000:0.0:1789264130.060271:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322713600:12345-0@lo:400: Request processed in 30us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264130.060277:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789264130.060288:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264130.060294:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3623:x1876179322714112:12345-0@lo:400: 00000100:00100000:0.0:1789264130.060317:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3623:x1876179322714112:12345-0@lo:400: Request processed in 23us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264130.060321:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264130.060331:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264130.060336:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322713728:12345-0@lo:400: 00000100:00100000:0.0:1789264130.060360:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322713728:12345-0@lo:400: Request processed in 24us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264130.060365:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264130.060373:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789264130.060379:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1876179322714240:12345-0@lo:400: 00000100:00100000:0.0:1789264130.060403:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1876179322714240:12345-0@lo:400: Request processed in 24us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264130.060409:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789264130.060430:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322712960 00000100:00100000:0.0:1789264130.060434:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322712960 00000100:00100000:0.0:1789264130.060458:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322713216 00000100:00100000:0.0:1789264130.060466:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322713216 00000100:00100000:0.0:1789264130.060481:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789264130.060486:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322712960:12345-0@lo:400: 00000100:00100000:0.0:1789264130.060517:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322712960:12345-0@lo:400: Request processed in 31us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264130.060522:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789264130.060533:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789264130.060538:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322713216:12345-0@lo:400: 00000100:00100000:0.0:1789264130.060564:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322713216:12345-0@lo:400: Request processed in 26us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264130.060570:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789264130.060627:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322712832:0@lo:400: 00000100:00100000:0.0:1789264130.060640:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322713344:0@lo:400: 00000100:00100000:0.0:1789264130.060649:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1876179322713856:0@lo:400: 00000100:00100000:0.0:1789264130.060656:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322712704:0@lo:400: 00000100:00100000:0.0:1789264130.060664:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322713216:0@lo:400: 00010000:00080000:0.0:1789264130.060675:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac69500 x1876179322713728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264130.060684:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322713728:0@lo:400: 00010000:00080000:0.0:1789264130.060693:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac69180 x1876179322714240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264130.060702:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322714240:0@lo:400: 00000100:00100000:0.0:1789264130.060740:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322712960:0@lo:400: 00010000:00080000:0.0:1789264130.060779:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac6b800 x1876179322713472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264130.060789:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1876179322713472:0@lo:400: 00010000:00080000:0.0:1789264130.060799:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac6aa00 x1876179322713984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264130.060806:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322713984:0@lo:400: 00010000:00080000:0.0:1789264130.060815:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abad83480 x1876179322712576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264130.060828:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322712576:0@lo:13: 00000100:00100000:0.0:1789264130.060837:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322713088:0@lo:400: 00010000:00080000:0.0:1789264130.060846:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac6bb80 x1876179322713600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264130.060853:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322713600:0@lo:400: 00010000:00080000:0.0:1789264130.060861:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac69f80 x1876179322714112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264130.060868:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322714112:0@lo:400: 00000100:00080000:3.0:1789264130.062564:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789264130.062573:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789264130.062576:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789264130.062579:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789264130.062585:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789264130.062602:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322714368:0@lo:13: 00000100:00100000:3.0:1789264130.062656:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264130.062693:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322714368 00000100:00100000:3.0:1789264130.062699:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322714368 00000100:00100000:3.0:1789264130.062738:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789264130.062769:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1876179322714368:12345-0@lo:13: 00002000:00000024:3.0:1789264130.062786:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264130.062833:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1876179322714368:12345-0@lo:13: Request processed in 74us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264130.062839:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789264130.062871:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abf56c000 x1876179322714368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264130.062886:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322714368:0@lo:13: 00000100:00100000:0.0:1789264130.570045:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322714496:0@lo:41: 00000100:00100000:0.0:1789264130.570109:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264130.570218:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322714496 00000100:00100000:2.0:1789264130.570227:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322714496 00000100:00100000:2.0:1789264130.570287:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789264130.570298:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322714496:12345-0@lo:41: 00000004:00000024:2.0:1789264130.570329:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789264130.574085:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322714496:12345-0@lo:41: Request processed in 3781us (3966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264130.574099:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789264130.575324:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322714496:0@lo:41: 00000001:00100000:1.0:1789264130.580092:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 92638a4f-1391-4305-a4ab-5961bcacc46a 00000001:00080000:1.0:1789264130.580107:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1789264130.580118:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1789264130.703659:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789264131.328393:0:10152:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1789264131.596671:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 92638a4f-1391-4305-a4ab-5961bcacc46a 00000001:00100000:0.0:1789264131.597029:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 92638a4f-1391-4305-a4ab-5961bcacc46a 00010000:00010000:1.0:1789264131.722088:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264132.561054:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264132.561094:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264132.561131:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264132.561165:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264132.561188:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264132.561212:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311137408 00000100:00100000:0.0:1789264132.561222:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311137408 00000100:00100000:0.0:1789264132.561270:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311137280 00000100:00100000:0.0:1789264132.561273:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311137280 00000100:00100000:0.0:1789264132.561293:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:0.0:1789264132.561302:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311137408:12345-192.168.203.44@tcp:400: 00000100:00100000:0.0:1789264132.561369:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311137408:12345-192.168.203.44@tcp:400: Request processed in 68us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264132.561377:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:0.0:1789264132.561394:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:0.0:1789264132.561401:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311137280:12345-192.168.203.44@tcp:400: 00000100:00100000:0.0:1789264132.561425:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311137280:12345-192.168.203.44@tcp:400: Request processed in 26us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264132.561431:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:0.0:1789264132.561449:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311137152 00000100:00100000:0.0:1789264132.561452:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311137152 00000100:00100000:0.0:1789264132.561490:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311137024 00000100:00100000:0.0:1789264132.561494:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311137024 00000100:00100000:0.0:1789264132.561517:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 38 00000100:00100000:0.0:1789264132.561523:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311137152:12345-192.168.203.44@tcp:400: 00000100:00100000:0.0:1789264132.561614:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311137152:12345-192.168.203.44@tcp:400: Request processed in 90us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264132.561679:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 38 00000100:00100000:0.0:1789264132.561703:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:0.0:1789264132.561709:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311137024:12345-192.168.203.44@tcp:400: 00000100:00100000:0.0:1789264132.561733:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311137024:12345-192.168.203.44@tcp:400: Request processed in 25us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264132.561740:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:3.0:1789264132.561984:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311136896 00000100:00100000:3.0:1789264132.561989:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311136896 00000100:00100000:3.0:1789264132.562081:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 191 00000100:00100000:3.0:1789264132.562089:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aaa0b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2402:x1876179311136896:12345-192.168.203.44@tcp:400: 00000100:00100000:3.0:1789264132.562123:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aaa0b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2402:x1876179311136896:12345-192.168.203.44@tcp:400: Request processed in 36us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264132.562129:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 191 00000100:00080000:3.0:1789264132.562165:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789264132.562169:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789264132.562171:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789264132.562173:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789264132.618891:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322714624:0@lo:13: 00000100:00100000:3.0:1789264132.618953:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264132.619012:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322714624 00000100:00100000:3.0:1789264132.619020:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322714624 00000100:00100000:3.0:1789264132.619074:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789264132.619084:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322714624:12345-0@lo:13: 00002000:00000024:3.0:1789264132.619109:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264132.619645:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789264132.619658:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322714752:0@lo:13: 00000100:00100000:0.0:1789264132.619863:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264132.620250:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322714624:12345-0@lo:13: Request processed in 1165us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264132.620259:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789264132.620288:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322714752 00000100:00100000:3.0:1789264132.620294:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322714752 00000100:00100000:3.0:1789264132.620325:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789264132.620334:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322714752:12345-0@lo:13: 00002000:00000024:3.0:1789264132.620351:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264132.620396:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322714752:12345-0@lo:13: Request processed in 64us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264132.620403:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789264132.620449:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789264132.620478:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abf56ea00 x1876179322714624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264132.620497:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322714624:0@lo:13: 00000001:00100000:3.0:1789264132.621836:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 92638a4f-1391-4305-a4ab-5961bcacc46a 00010000:00080000:0.0:1789264132.622385:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398374d500 x1876179322714752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264132.622411:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322714752:0@lo:13: 00010000:00010000:1.0:1789264132.746478:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264133.135400:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789264133.135436:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322714880:0@lo:41: 00000100:00100000:1.0:1789264133.135530:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264133.135644:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322714880 00000100:00100000:3.0:1789264133.135654:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322714880 00000100:00100000:3.0:1789264133.135739:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789264133.135773:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322714880:12345-0@lo:41: 00000004:00000024:3.0:1789264133.135815:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789264133.135869:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322714880:12345-0@lo:41: Request processed in 98us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264133.135876:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789264133.135973:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322714880:0@lo:41: 00010000:00010000:1.0:1789264133.771419:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789264134.057712:0:10300:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1a9bd880 20000000:00000080:0.0:1789264134.057728:0:10300:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c39835a4800 uarg=0000000000000000 20000000:01000000:0.0:1789264134.058054:0:10300:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789264134.058058:0:10300:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789264134.058060:0:10300:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789264134.058065:0:10300:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789264134.058069:0:10300:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789264134.058127:0:10300:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789264134.058130:0:10300:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789264134.058625:0:10301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1789264134.059093:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1789264134.059123:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1789264134.059150:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1789264134.059161:0:10300:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789264134.059163:0:10300:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789264134.059433:0:10302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1789264134.059583:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1789264134.059603:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1789264134.059618:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1789264134.059642:0:10300:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789264134.059643:0:10300:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789264134.060084:0:10303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1789264134.060248:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1789264134.060268:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1789264134.060281:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1789264134.060289:0:10300:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789264134.060291:0:10300:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789264134.060625:0:10304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1789264134.061209:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1789264134.061238:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1789264134.061271:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1789264134.061283:0:10300:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789264134.061285:0:10300:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789264134.061976:0:10305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1789264134.062184:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1789264134.062209:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1789264134.062222:0:10300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:0.0:1789264134.062233:0:10300:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789264134.062252:0:10300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062269:0:10300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed6a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a7a expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062276:0:10300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a80031000/0xecaf9f2f14ed6aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6aa4 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062281:0:10300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed6aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6ae3 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062287:0:10300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed6af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6af1 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062292:0:10300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6aff expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062310:0:10300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8f094800/0xecaf9f2f14ed6b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b1b expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062315:0:10300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b3e expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062319:0:10300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b61 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062323:0:10300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6b92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b8b expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062328:0:10300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8f094000/0xecaf9f2f14ed6ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda925 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062333:0:10300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda92c expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062337:0:10300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062365:0:10300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda92c expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062376:0:10300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6ba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda92c expref: 9 pid: 6482 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.062386:0:10300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715008:192.168.203.44@tcp:104: 00010000:00010000:0.0:1789264134.062507:0:10300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8f094000/0xecaf9f2f14ed6ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda925 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062518:0:10300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3a8f094000/0xecaf9f2f14ed6ba0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda925 expref: 9 pid: 6484 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.062524:0:10300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac69f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715136:192.168.203.44@tcp:104: 00010000:00010000:0.0:1789264134.062546:0:10300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6b8b expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062551:0:10300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6b92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b8b expref: 23 pid: 6482 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.062556:0:10300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715264:0@lo:104: 00000100:00100000:0.0:1789264134.062580:0:10300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789264134.062633:0:10300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6b61 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.062638:0:10300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6b68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b61 expref: 23 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.062643:0:10300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715392:0@lo:104: 00000100:00100000:0.0:1789264134.062655:0:10300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789264134.063194:0:10300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6b3e expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.063203:0:10300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6b45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b3e expref: 23 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.063212:0:10300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715520:0@lo:104: 00000100:00100000:0.0:1789264134.063235:0:10300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264134.064098:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322715264 00000100:00100000:2.0:1789264134.064108:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322715264 00010000:00010000:0.0:1789264134.064194:0:10300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8f094800/0xecaf9f2f14ed6b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6b1b expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.064204:0:10300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8f094800/0xecaf9f2f14ed6b22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b1b expref: 23 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.064214:0:10300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac69500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715648:0@lo:104: 00000100:00100000:0.0:1789264134.064247:0:10300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789264134.064264:0:10300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6aff expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.064272:0:10300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6b06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6aff expref: 23 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.064279:0:10300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac68a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715776:0@lo:104: 00010000:00010000:0.0:1789264134.064321:0:10300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed6af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6af1 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.064330:0:10300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed6af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6af1 expref: 23 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.064338:0:10300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715904:0@lo:104: 00010000:00010000:0.0:1789264134.064359:0:10300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed6aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6ae3 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.064367:0:10300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed6aea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6ae3 expref: 23 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.064374:0:10300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac68000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322716032:0@lo:104: 00010000:00010000:0.0:1789264134.064395:0:10300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a80031000/0xecaf9f2f14ed6aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6aa4 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.064410:0:10300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a80031000/0xecaf9f2f14ed6aab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6aa4 expref: 23 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.064418:0:10300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322716160:0@lo:104: 00010000:00010000:0.0:1789264134.064445:0:10300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed6a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6a7a expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.064453:0:10300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed6a81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a7a expref: 23 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.064460:0:10300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322716288:0@lo:104: 00000100:00100000:0.0:1789264134.064478:0:10300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789264134.064513:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322715392 00000100:00100000:1.0:1789264134.064518:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322715392 00000100:00100000:1.0:1789264134.064552:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789264134.064580:0:6474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264134.064596:0:6474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264134.064605:0:6474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264134.064613:0:6474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264134.064621:0:6474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264134.064627:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322715520 00000100:00100000:1.0:1789264134.064631:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322715520 00000100:00100000:1.0:1789264134.064646:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322715648 00000100:00100000:1.0:1789264134.064649:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322715648 00000100:00100000:1.0:1789264134.064658:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322715776 00000100:00100000:1.0:1789264134.064667:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322715776 00000100:00100000:1.0:1789264134.064680:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322715904 00000100:00100000:1.0:1789264134.064682:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322715904 00000100:00100000:1.0:1789264134.064691:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322716032 00000100:00100000:1.0:1789264134.064694:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322716032 00000100:00100000:1.0:1789264134.064702:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322716160 00000100:00100000:1.0:1789264134.064704:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322716160 00000100:00100000:1.0:1789264134.064712:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322716288 00000100:00100000:1.0:1789264134.064715:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322716288 00000100:00100000:1.0:1789264134.064885:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789264134.064967:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:10300:x1876179322715392:12345-0@lo:104: 00010000:00010000:1.0:1789264134.064981:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6b68 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.065150:0:10300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715392:0@lo:104: 00010000:00010000:1.0:1789264134.065184:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789264134.065190:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+11:10300:x1876179322715392:12345-0@lo:104: Request processed in 295us (2532us total) trans 0 rc 0/0 00010000:00010000:3.0:1789264134.065211:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264134.065218:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6b68 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.065225:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1789264134.065229:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6b68 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.065244:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6b68 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789264134.065251:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6b68 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264134.065256:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789264134.065324:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b68 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.065331:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789264134.065350:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b68 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.065356:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a600/0xecaf9f2f14ed6b61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b68 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.065370:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264134.065372:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264134.065373:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264134.065384:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322716416:0@lo:103: 00000100:00100000:3.0:1789264134.065417:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264134.065459:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322716416 00000100:00100000:3.0:1789264134.065464:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322716416 00010000:00010000:3.0:1789264134.065489:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6b68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b61 expref: 24 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264134.065512:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789264134.065519:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2785850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322716416:12345-0@lo:103: 00010000:00010000:3.0:1789264134.065535:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264134.065542:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6b68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b61 expref: 24 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.065551:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b61 expref: 24 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.065566:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6b68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b61 expref: 24 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.065578:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264134.065604:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2785850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:3622:x1876179322716416:12345-0@lo:103: Request processed in 86us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264134.065610:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789264134.065666:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322716416:0@lo:103: 00000100:00100000:1.0:1789264134.065705:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789264134.065721:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789264134.065836:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+10:10300:x1876179322715520:12345-0@lo:104: 00010000:00010000:1.0:1789264134.065848:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6b45 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.065996:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789264134.066001:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+10:10300:x1876179322715520:12345-0@lo:104: Request processed in 274us (2766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264134.066007:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789264134.066021:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789264134.066029:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab44050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+9:10300:x1876179322715648:12345-0@lo:104: 00010000:00010000:1.0:1789264134.066046:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6b22 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264134.066284:0:10300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715520:0@lo:104: 00000100:00100000:2.0:1789264134.066294:0:10300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac69500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715648:0@lo:104: 00010000:00010000:3.0:1789264134.066469:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789264134.066476:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6b45 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.066488:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36bc00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1789264134.066491:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6b45 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.066499:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789264134.066500:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6b45 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.066505:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab44050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+9:10300:x1876179322715648:12345-0@lo:104: Request processed in 478us (2258us total) trans 0 rc 0/0 10000000:00010000:3.0:1789264134.066506:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6b45 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264134.066512:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789264134.066512:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789264134.066527:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789264134.066533:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+8:10300:x1876179322715776:12345-0@lo:104: 00010000:00010000:3.0:1789264134.066539:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b45 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.066540:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.066546:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789264134.066559:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b45 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.066566:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6b3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b45 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.066576:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789264134.066576:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789264134.066579:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6b22 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.066581:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+8:10300:x1876179322715776:12345-0@lo:104: Request processed in 49us (2001us total) trans 0 rc 0/0 00010000:00010000:3.0:1789264134.066586:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622e00 already unused, calling callback (ffffffffc148ec20) 00000100:00100000:1.0:1789264134.066587:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 10000000:00010000:3.0:1789264134.066589:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6b22 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.066595:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6b22 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.066598:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 10000000:00010000:3.0:1789264134.066603:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6b22 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.066604:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+7:10300:x1876179322715904:12345-0@lo:104: 10000000:01000000:3.0:1789264134.066608:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789264134.066610:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.066619:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b22 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.066625:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264134.066634:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789264134.066638:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b22 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.066639:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+7:10300:x1876179322715904:12345-0@lo:104: Request processed in 35us (2042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264134.066644:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1789264134.066655:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622e00/0xecaf9f2f14ed6b1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b22 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.066655:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789264134.066660:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+6:10300:x1876179322716032:12345-0@lo:104: 00010000:00010000:3.0:1789264134.066664:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789264134.066667:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.066672:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a80030000 already unused, calling callback (ffffffffc148ec20) 00010000:00010000:1.0:1789264134.066672:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789264134.066675:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.066682:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789264134.066687:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264134.066692:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789264134.066697:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789264134.066701:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+6:10300:x1876179322716032:12345-0@lo:104: Request processed in 42us (2096us total) trans 0 rc 0/0 00010000:00010000:3.0:1789264134.066704:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.066707:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1789264134.066710:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789264134.066715:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.066722:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a80030000/0xecaf9f2f14ed6aff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.066731:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789264134.066811:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264134.066816:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264134.066823:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a80031200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264134.066826:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264134.066833:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264134.066839:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264134.066844:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789264134.066860:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.066860:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1789264134.066865:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789264134.066867:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:10300:x1876179322716160:12345-0@lo:104: 00010000:00010000:2.0:1789264134.066871:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.066874:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6aab expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264134.066877:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6ae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264134.066887:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264134.066888:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264134.066895:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264134.066933:0:10300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac68a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715776:0@lo:104: 00000100:00100000:2.0:1789264134.066941:0:10300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715904:0@lo:104: 00000100:00100000:2.0:1789264134.066948:0:10300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac68000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322716032:0@lo:104: 00000100:00100000:2.0:1789264134.066955:0:10300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322716160:0@lo:104: 00010000:00010000:1.0:1789264134.066973:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789264134.066979:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:10300:x1876179322716160:12345-0@lo:104: Request processed in 113us (2365us total) trans 0 rc 0/0 00010000:00010000:2.0:1789264134.066981:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264134.066985:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6aab expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264134.066992:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264134.066995:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6aab expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264134.067001:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6aab expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264134.067006:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6aab expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264134.067011:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789264134.067025:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6aab expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264134.067030:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789264134.067034:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6aab expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264134.067040:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623600/0xecaf9f2f14ed6aa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6aab expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.067056:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1789264134.067059:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264134.067060:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264134.067062:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264134.067072:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789264134.067078:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:10300:x1876179322716288:12345-0@lo:104: 00010000:00010000:1.0:1789264134.067086:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6a81 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.067194:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789264134.067199:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:10300:x1876179322716288:12345-0@lo:104: Request processed in 123us (2577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264134.067205:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789264134.067219:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789264134.067225:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:10300:x1876179322715264:12345-0@lo:104: 00000100:00100000:0.0:1789264134.067234:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00010000:00010000:1.0:1789264134.067236:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6b92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.067262:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789264134.067264:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264134.067266:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:10300:x1876179322715264:12345-0@lo:104: Request processed in 42us (4685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264134.067272:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789264134.067284:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311137536 00000100:00100000:0.0:1789264134.067288:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311137536 00010000:00010000:1.0:1789264134.067304:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789264134.067309:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6a81 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.067311:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6ba7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda92c expref: 10 pid: 6482 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.067316:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264134.067319:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6a81 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.067325:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6a81 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.067329:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311137664 00000100:00100000:0.0:1789264134.067331:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311137664 10000000:00010000:1.0:1789264134.067332:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6a81 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264134.067337:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789264134.067341:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8f094000/0xecaf9f2f14ed6ba0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda925 expref: 11 pid: 6484 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.067349:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a81 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.067356:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789264134.067356:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 25 00010000:00010000:1.0:1789264134.067360:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a81 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.067362:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:2403:x1876179311137536:12345-192.168.203.44@tcp:103: 00010000:00010000:1.0:1789264134.067367:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed6a7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a81 expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.067380:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264134.067380:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264134.067383:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6b92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.067385:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6ba7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda92c expref: 11 pid: 6482 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.067390:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264134.067392:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6b92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.067395:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6ba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda92c expref: 11 pid: 6482 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.067399:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6b92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264134.067404:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6b92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264134.067408:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789264134.067409:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789264134.067420:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.067425:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264134.067429:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.067434:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b600/0xecaf9f2f14ed6b8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6b92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.067442:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264134.067442:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:2403:x1876179311137536:12345-192.168.203.44@tcp:103: Request processed in 81us (209us total) trans 0 rc 0/0 00010000:00010000:1.0:1789264134.067443:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264134.067445:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264134.067449:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:0.0:1789264134.067465:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:0.0:1789264134.067472:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2403:x1876179311137664:12345-192.168.203.44@tcp:103: 00010000:00010000:3.0:1789264134.067511:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264134.067515:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6ba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda92c expref: 10 pid: 6482 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.067517:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1789264134.067520:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264134.067524:0:10300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715008:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264134.067527:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264134.067532:0:10300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac69f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715136:192.168.203.44@tcp:104: 10000000:00010000:3.0:1789264134.067534:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264134.067538:0:10300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322715264:0@lo:104: 10000000:01000000:3.0:1789264134.067539:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789264134.067545:0:10300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10300:1876179322716288:0@lo:104: 00010000:00010000:3.0:1789264134.067554:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.067559:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789264134.067563:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.067569:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6af1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264134.067579:0:10300:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.067580:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264134.067581:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264134.067583:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264134.067597:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322716672:0@lo:103: 00010000:00010000:0.0:1789264134.067613:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264134.067618:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8f094000/0xecaf9f2f14ed6ba0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda925 expref: 9 pid: 6484 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264134.067627:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789264134.067628:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8f094000/0xecaf9f2f14ed6ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda925 expref: 9 pid: 6484 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.067638:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f094000/0xecaf9f2f14ed6ba0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda925 expref: 9 pid: 6484 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.067648:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264134.067663:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322717184:0@lo:103: 00000100:00100000:0.0:1789264134.067665:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+8:2403:x1876179311137664:12345-192.168.203.44@tcp:103: Request processed in 195us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264134.067671:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:0.0:1789264134.067682:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322716672 00000100:00100000:0.0:1789264134.067689:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322716672 00000100:00100000:3.0:1789264134.067692:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789264134.067702:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8f094800/0xecaf9f2f14ed6b22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b1b expref: 23 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264134.067705:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789264134.067710:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322716800:0@lo:103: 00000100:00100000:0.0:1789264134.067713:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322717184 00000100:00100000:0.0:1789264134.067715:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322717184 00010000:00010000:0.0:1789264134.067725:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed6a81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a7a expref: 24 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.067839:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789264134.067846:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322716672:12345-0@lo:103: 00010000:00010000:0.0:1789264134.067854:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264134.067858:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8f094800/0xecaf9f2f14ed6b22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b1b expref: 24 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.067866:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8f094800/0xecaf9f2f14ed6b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b1b expref: 24 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264134.067877:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f094800/0xecaf9f2f14ed6b22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b1b expref: 24 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.067882:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1789264134.067886:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264134.067896:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:3624:x1876179322717184:12345-0@lo:103: 00010000:00010000:1.0:1789264134.067962:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264134.067969:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed6a81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a7a expref: 23 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.067977:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed6a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a7a expref: 23 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264134.068017:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:3624:x1876179322716672:12345-0@lo:103: Request processed in 171us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264134.068023:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789264134.068323:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a80031c00/0xecaf9f2f14ed6a81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a7a expref: 22 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.068335:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264134.068361:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:3624:x1876179322717184:12345-0@lo:103: Request processed in 466us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264134.068367:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789264134.068890:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264134.068928:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322717312:0@lo:103: 00000100:00100000:3.0:1789264134.068955:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264134.069051:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322716800 00000100:00100000:3.0:1789264134.069054:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322716672:0@lo:103: 00000100:00100000:1.0:1789264134.069056:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322716800 00000100:00100000:3.0:1789264134.069067:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322717184:0@lo:103: 00010000:00010000:1.0:1789264134.069076:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6b06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6aff expref: 21 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.069108:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322717312 00000100:00100000:1.0:1789264134.069111:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322717312 00000100:00100000:3.0:1789264134.069112:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1789264134.069122:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6b92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b8b expref: 22 pid: 6482 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264134.069123:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:3624:x1876179322716800:12345-0@lo:103: 00010000:00010000:3.0:1789264134.069131:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789264134.069133:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1789264134.069145:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6b06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6aff expref: 22 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.069149:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:3624:x1876179322717312:12345-0@lo:103: 00010000:00010000:1.0:1789264134.069155:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264134.069156:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6aff expref: 22 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.069159:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6b92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b8b expref: 22 pid: 6482 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.069168:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5622000/0xecaf9f2f14ed6b06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6aff expref: 22 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.069177:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789264134.069180:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b8b expref: 21 pid: 6482 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.069189:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5623400/0xecaf9f2f14ed6b92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b8b expref: 21 pid: 6482 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.069197:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264134.069203:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:3624:x1876179322716800:12345-0@lo:103: Request processed in 85us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264134.069209:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789264134.069215:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:3624:x1876179322717312:12345-0@lo:103: Request processed in 68us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264134.069220:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789264134.069232:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322716800:0@lo:103: 00000100:00100000:3.0:1789264134.069241:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322717312:0@lo:103: 00000100:00100000:3.0:1789264134.069270:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322716544:0@lo:103: 00000100:00100000:3.0:1789264134.069296:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264134.069322:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322717056:0@lo:103: 00000100:00100000:3.0:1789264134.069342:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264134.069355:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322716544 00000100:00100000:1.0:1789264134.069359:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322716544 00000100:00100000:3.0:1789264134.069360:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789264134.069365:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322716928:0@lo:103: 00010000:00010000:1.0:1789264134.069371:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6b45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b3e expref: 19 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264134.069383:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264134.069386:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322717056 00000100:00100000:1.0:1789264134.069389:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322717056 00000100:00100000:3.0:1789264134.069393:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322717440:0@lo:103: 00010000:00010000:1.0:1789264134.069398:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a80031000/0xecaf9f2f14ed6aab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6aa4 expref: 20 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.069408:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322716928 00000100:00100000:3.0:1789264134.069410:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264134.069410:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322716928 00010000:00010000:1.0:1789264134.069419:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed6aea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6ae3 expref: 21 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.069428:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322717440 00010000:00010000:3.0:1789264134.069430:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264134.069431:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322717440 00000100:00100000:3.0:1789264134.069439:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1789264134.069440:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed6af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6af1 expref: 22 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264134.069446:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2786850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:3623:x1876179322716544:12345-0@lo:103: 00000100:00100000:1.0:1789264134.069450:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1789264134.069453:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264134.069457:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6b45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b3e expref: 22 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.069460:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:3623:x1876179322717056:12345-0@lo:103: 00010000:00010000:3.0:1789264134.069467:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b3e expref: 22 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.069467:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264134.069471:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a80031000/0xecaf9f2f14ed6aab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6aa4 expref: 22 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.069477:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6b45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6b3e expref: 22 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.069478:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a80031000/0xecaf9f2f14ed6aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6aa4 expref: 22 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.069487:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789264134.069487:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a80031000/0xecaf9f2f14ed6aab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6aa4 expref: 21 pid: 6485 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.069495:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264134.069510:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2786850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:3623:x1876179322716544:12345-0@lo:103: Request processed in 65us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264134.069511:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:3623:x1876179322717056:12345-0@lo:103: Request processed in 52us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264134.069517:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789264134.069652:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789264134.069656:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789264134.069666:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789264134.069670:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:3623:x1876179322716928:12345-0@lo:103: 00000100:00100000:1.0:1789264134.069671:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:3623:x1876179322717440:12345-0@lo:103: 00010000:00010000:3.0:1789264134.069678:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264134.069678:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264134.069683:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed6aea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6ae3 expref: 18 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.069683:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed6af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6af1 expref: 18 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.069691:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed6aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6ae3 expref: 18 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.070371:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed6af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6af1 expref: 18 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.070385:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed6af8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6af1 expref: 18 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264134.070396:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264134.070432:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:3623:x1876179322717440:12345-0@lo:103: Request processed in 760us (1021us total) trans 0 rc 0/0 00010000:00010000:3.0:1789264134.070433:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed6aea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6ae3 expref: 17 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.070445:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264134.070449:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1789264134.070452:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.070466:0:8420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.070473:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.070479:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.070486:0:8420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.070492:0:8420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a80030400 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264134.070495:0:8420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.070509:0:8420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.070523:0:8420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.070534:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264134.070552:0:10300:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264134.070558:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:3623:x1876179322716928:12345-0@lo:103: Request processed in 891us (1174us total) trans 0 rc 0/0 00010000:00010000:0.0:1789264134.070561:0:10300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264134.070565:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1789264134.070577:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6be6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264134.070594:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322716928:0@lo:103: 00000100:00100000:3.0:1789264134.070603:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322717440:0@lo:103: 00000100:00100000:3.0:1789264134.070609:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322716544:0@lo:103: 00000100:00100000:3.0:1789264134.070615:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322717056:0@lo:103: 00000100:00100000:3.0:1789264134.477577:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264134.480449:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311137792 00000100:00100000:2.0:1789264134.480465:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311137792 00000100:00100000:2.0:1789264134.480544:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 192 00000100:00100000:2.0:1789264134.480556:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+8:6166:x1876179311137792:12345-192.168.203.44@tcp:101: 00010000:00010000:2.0:1789264134.480573:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264134.480592:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6bed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bda99c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264134.480619:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda99c expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264134.480630:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda99c expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264134.480656:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623e00, rc 0) 00000100:00100000:2.0:1789264134.480724:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6166:x1876179311137792:12345-192.168.203.44@tcp:101: Request processed in 171us (3155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264134.480731:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 192 00000100:00100000:0.0:1789264134.487664:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264134.487839:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311137920 00000100:00100000:2.0:1789264134.487849:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311137920 00000100:00100000:2.0:1789264134.487923:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 193 00000100:00100000:2.0:1789264134.487934:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6166:x1876179311137920:12345-192.168.203.44@tcp:501: 00000100:00100000:2.0:1789264134.488101:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6166:x1876179311137920:12345-192.168.203.44@tcp:501: Request processed in 169us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264134.488109:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 193 00000100:00100000:0.0:1789264134.493192:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264134.493284:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311138048 00000100:00100000:3.0:1789264134.493294:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311138048 00000100:00100000:3.0:1789264134.493356:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 194 00000100:00100000:3.0:1789264134.493368:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6166:x1876179311138048:12345-192.168.203.44@tcp:503: 00000100:00100000:3.0:1789264134.493505:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6166:x1876179311138048:12345-192.168.203.44@tcp:503: Request processed in 139us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264134.493512:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 194 00000100:00100000:3.0:1789264134.505508:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264134.505740:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311138176 00000100:00100000:0.0:1789264134.505775:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311138176 00000100:00100000:0.0:1789264134.505829:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 195 00000100:00100000:0.0:1789264134.505839:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6640:x1876179311138176:12345-192.168.203.44@tcp:502: 00000100:00100000:0.0:1789264134.506118:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6640:x1876179311138176:12345-192.168.203.44@tcp:502: Request processed in 279us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264134.506125:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 195 00000100:00100000:0.0:1789264134.515088:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264134.515916:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311138304 00000100:00100000:2.0:1789264134.515927:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311138304 00000100:00100000:2.0:1789264134.516006:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 196 00000100:00100000:2.0:1789264134.516017:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6640:x1876179311138304:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789264134.516191:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6640:x1876179311138304:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 176us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264134.516200:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 196 00000100:00100000:2.0:1789264134.521797:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264134.522034:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311138432 00000100:00100000:3.0:1789264134.522046:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311138432 00000100:00100000:3.0:1789264134.522147:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 197 00000100:00100000:3.0:1789264134.522160:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6166:x1876179311138432:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264134.522176:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264134.522195:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6bf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bda9a3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.522222:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9a3 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.522233:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9a3 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264134.522397:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36ba00, rc 0) 00000100:00100000:3.0:1789264134.522517:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6166:x1876179311138432:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 360us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264134.522524:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 197 00000100:00100000:3.0:1789264134.529466:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264134.529599:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311138560 00000100:00100000:0.0:1789264134.529609:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311138560 00000100:00100000:0.0:1789264134.529671:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 198 00000100:00100000:0.0:1789264134.529681:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6166:x1876179311138560:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264134.529837:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6166:x1876179311138560:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 157us (381us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789264134.529845:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 198 00010000:00010000:1.0:1789264134.795526:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264135.178222:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322717696:0@lo:400: 00000100:00100000:3.0:1789264135.178256:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322717824:0@lo:400: 00000100:00100000:2.0:1789264135.178299:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264135.178305:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.178359:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322718208:0@lo:400: 00000100:00100000:1.0:1789264135.178385:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322717568:0@lo:400: 00000100:00100000:2.0:1789264135.178386:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.178417:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322718592:0@lo:13: 00000100:00100000:1.0:1789264135.178430:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.178460:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.178466:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322718080:0@lo:400: 00000100:00100000:2.0:1789264135.178493:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322719232:0@lo:400: 00000100:00100000:1.0:1789264135.178497:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.178525:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322718720:0@lo:400: 00000100:00100000:2.0:1789264135.178533:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.178560:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.178576:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322717952:0@lo:400: 00000100:00100000:1.0:1789264135.178583:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322719104:0@lo:400: 00000100:00100000:1.0:1789264135.178618:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.178623:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.178652:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322718464:0@lo:400: 00000100:00100000:1.0:1789264135.178656:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322717824 00000100:00100000:1.0:1789264135.178664:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322717824 00000100:00100000:2.0:1789264135.178680:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.178693:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322718976:0@lo:400: 00000100:00100000:2.0:1789264135.178715:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.178721:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322718080 00000100:00100000:1.0:1789264135.178726:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322718080 00000100:00100000:2.0:1789264135.178771:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322717696 00000100:00100000:2.0:1789264135.178777:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322717696 00000100:00100000:1.0:1789264135.178783:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789264135.178794:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322717824:12345-0@lo:400: 00000100:00100000:2.0:1789264135.178813:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322718208 00000100:00100000:2.0:1789264135.178817:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322718208 00000100:00100000:2.0:1789264135.178842:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322717952 00000100:00100000:2.0:1789264135.178845:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322717952 00000100:00100000:1.0:1789264135.178849:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322717824:12345-0@lo:400: Request processed in 55us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.178858:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789264135.178861:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322718976 00000100:00100000:2.0:1789264135.178865:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322718976 00000100:00100000:1.0:1789264135.178881:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789264135.178888:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789264135.178892:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322718080:12345-0@lo:400: 00000100:00100000:2.0:1789264135.178901:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322717696:12345-0@lo:400: 00000100:00100000:1.0:1789264135.178934:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322718080:12345-0@lo:400: Request processed in 45us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.178941:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789264135.178954:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322717696:12345-0@lo:400: Request processed in 55us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264135.178963:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789264135.178980:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789264135.178988:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876179322718208:12345-0@lo:400: 00000100:00100000:1.0:1789264135.179000:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322718080:0@lo:400: 00000100:00100000:2.0:1789264135.179018:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876179322718208:12345-0@lo:400: Request processed in 31us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264135.179026:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789264135.179051:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789264135.179057:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264135.179063:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789264135.179071:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322719232 00000100:00100000:2.0:1789264135.179074:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322717952:12345-0@lo:400: 00000100:00100000:1.0:1789264135.179077:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322719232 00000100:00100000:1.0:1789264135.179108:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322718720 00000100:00100000:1.0:1789264135.179112:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322718720 00000100:00100000:2.0:1789264135.179120:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322717952:12345-0@lo:400: Request processed in 48us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264135.179138:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789264135.179138:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322719104 00000100:00100000:1.0:1789264135.179143:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322719104 00000100:00100000:2.0:1789264135.179159:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789264135.179169:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322718464 00000100:00100000:2.0:1789264135.179171:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322718976:12345-0@lo:400: 00000100:00100000:1.0:1789264135.179174:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322718464 00000100:00100000:1.0:1789264135.179198:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789264135.179207:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322719232:12345-0@lo:400: 00000100:00100000:2.0:1789264135.179212:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322718976:12345-0@lo:400: Request processed in 43us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264135.179220:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789264135.179243:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789264135.179251:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322719232:12345-0@lo:400: Request processed in 45us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264135.179252:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789264135.179262:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789264135.179282:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789264135.179291:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322717952:0@lo:400: 00000100:00100000:1.0:1789264135.179292:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322718720:12345-0@lo:400: 00010000:00080000:2.0:1789264135.179315:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ababbc380 x1876179322718976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264135.179327:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322718976:0@lo:400: 00000100:00100000:1.0:1789264135.179340:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322718720:12345-0@lo:400: Request processed in 50us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.179347:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789264135.179360:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ababbdc00 x1876179322719232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264135.179364:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789264135.179375:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789264135.179375:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322719104:12345-0@lo:400: 00000100:00100000:2.0:1789264135.179391:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322719232:0@lo:400: 00000100:00100000:2.0:1789264135.179404:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322717696:0@lo:400: 00000100:00100000:0.0:1789264135.179528:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789264135.179540:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789264135.179548:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322718464:12345-0@lo:400: 00000100:00100000:1.0:1789264135.180074:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322719104:12345-0@lo:400: Request processed in 699us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.180082:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789264135.180105:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322718592 00000100:00100000:1.0:1789264135.180109:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322718592 00000100:00100000:1.0:1789264135.180151:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789264135.180159:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322718592:12345-0@lo:13: 00002000:00000024:1.0:1789264135.180189:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264135.180239:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322718592:12345-0@lo:13: Request processed in 81us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.180245:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1789264135.180266:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789264135.180269:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789264135.180292:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3a8f348380 x1876179322718720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264135.180304:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322718720:0@lo:400: 00010000:00080000:1.0:1789264135.180315:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ababbc700 x1876179322719104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264135.180322:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789264135.180336:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322719104:0@lo:400: 00000100:00100000:1.0:1789264135.180359:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322717568 00000100:00100000:1.0:1789264135.180363:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322717568 00000100:00100000:1.0:1789264135.180391:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789264135.180397:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:3623:x1876179322717568:12345-0@lo:400: 00000100:00100000:1.0:1789264135.180433:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:3623:x1876179322717568:12345-0@lo:400: Request processed in 36us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.180439:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789264135.180471:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322717568:0@lo:400: 00000100:00100000:2.0:1789264135.180753:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322718208:0@lo:400: 00010000:00080000:2.0:1789264135.180768:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abad81180 x1876179322718592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264135.180796:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322718592:0@lo:13: 00000100:00100000:2.0:1789264135.180820:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789264135.180828:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322719360:0@lo:13: 00000100:00100000:2.0:1789264135.180860:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.180889:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322719360 00000100:00100000:2.0:1789264135.180893:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322719360 00000100:00100000:2.0:1789264135.180915:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789264135.180922:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322719360:12345-0@lo:13: 00002000:00000024:2.0:1789264135.180933:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264135.180964:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322719360:12345-0@lo:13: Request processed in 43us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264135.180971:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789264135.180994:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39837f2d80 x1876179322719360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264135.181006:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322719360:0@lo:13: 00000100:00100000:3.0:1789264135.181627:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322717824:0@lo:400: 00000100:00100000:3.0:1789264135.181637:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983111880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322718336:0@lo:400: 00000100:00100000:3.0:1789264135.181675:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264135.181702:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322718848:0@lo:400: 00000100:00100000:3.0:1789264135.181730:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.182113:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322718336 00000100:00100000:1.0:1789264135.182118:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322718336 00000100:00100000:1.0:1789264135.182176:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322718848 00000100:00100000:1.0:1789264135.182180:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322718848 00000100:00100000:1.0:1789264135.182201:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789264135.182217:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322718336:12345-0@lo:400: 00000100:00100000:1.0:1789264135.182258:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322718336:12345-0@lo:400: Request processed in 42us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.182264:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789264135.182277:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789264135.182283:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322718848:12345-0@lo:400: 00000100:00100000:1.0:1789264135.182321:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322718848:12345-0@lo:400: Request processed in 38us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.182327:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1789264135.182393:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789264135.182397:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789264135.182417:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983111880 x1876179322718336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264135.182433:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983111880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322718336:0@lo:400: 00000100:00100000:3.0:1789264135.182445:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322718848:0@lo:400: 00000100:00100000:0.0:1789264135.182644:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322718464:12345-0@lo:400: Request processed in 3096us (3962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.182661:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789264135.183343:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abab43480 x1876179322718464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264135.183357:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322718464:0@lo:400: 00000100:00100000:2.0:1789264135.693393:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322719488:0@lo:41: 00000100:00100000:2.0:1789264135.693848:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.693972:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322719488 00000100:00100000:0.0:1789264135.693980:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322719488 00000100:00100000:0.0:1789264135.694038:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789264135.694048:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322719488:12345-0@lo:41: 00000004:00000024:0.0:1789264135.694081:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789264135.694147:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322719488:12345-0@lo:41: Request processed in 101us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.694155:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789264135.694191:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322719488:0@lo:41: 10000000:01000000:2.0:1789264135.753888:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789264135.753903:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3ab7f50000 from 48 10000000:01000000:2.0:1789264135.753909:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789264135.753975:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264135.753987:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264135.753998:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264135.754021:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322719616:0@lo:101: 00000100:00100000:2.0:1789264135.754100:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.754294:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a881956c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.754522:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322719616 00000100:00100000:1.0:1789264135.754531:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322719616 00000100:00100000:1.0:1789264135.754618:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789264135.754629:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+15:6487:x1876179322719616:12345-0@lo:101: 00010000:00010000:1.0:1789264135.754642:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264135.754657:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed6c02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6bfb expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.754679:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed6c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6bfb expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.754701:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed6c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6bfb expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.754709:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f095400, rc 0) 00000100:00100000:1.0:1789264135.754802:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322719616:12345-0@lo:101: Request processed in 174us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.754809:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789264135.754909:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322719616:0@lo:101: 00010000:00010000:2.0:1789264135.754926:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264135.754936:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264135.754997:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322719744:0@lo:501: 00000100:00100000:2.0:1789264135.755024:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.755336:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a881956c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264135.755415:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322719744 00000100:00100000:3.0:1789264135.755420:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322719744 00000100:00100000:3.0:1789264135.755450:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789264135.755458:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322719744:12345-0@lo:501: 00000100:00100000:3.0:1789264135.755614:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322719744:12345-0@lo:501: Request processed in 156us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264135.755621:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789264135.755704:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322719744:0@lo:501: 00000100:00100000:2.0:1789264135.755865:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322719872:0@lo:503: 00000100:00100000:2.0:1789264135.755980:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.756042:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a881956c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264135.756077:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322719872 00000100:00100000:3.0:1789264135.756157:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322719872 00000100:00100000:3.0:1789264135.756227:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789264135.756236:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322719872:12345-0@lo:503: 00000100:00100000:3.0:1789264135.756392:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322719872:12345-0@lo:503: Request processed in 158us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264135.756400:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789264135.756466:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322719872:0@lo:503: 00000100:00100000:3.0:1789264135.757264:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10336:1876179322720000:0@lo:502: 00000100:00100000:3.0:1789264135.757326:0:10336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264135.757357:0:10336:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.757414:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322720000 00000100:00100000:0.0:1789264135.757419:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322720000 00000100:00100000:0.0:1789264135.757454:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789264135.757462:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:10336:x1876179322720000:12345-0@lo:502: 00000100:00100000:0.0:1789264135.757565:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:10336:x1876179322720000:12345-0@lo:502: Request processed in 103us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.757572:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789264135.757663:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10336:1876179322720000:0@lo:502: 00000100:00100000:3.0:1789264135.757703:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10336:1876179322720128:0@lo:502: 00000100:00100000:3.0:1789264135.757734:0:10336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264135.757791:0:10336:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.757849:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322720128 00000100:00100000:1.0:1789264135.757859:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322720128 00000100:00100000:1.0:1789264135.757880:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789264135.757886:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:10336:x1876179322720128:12345-0@lo:502: 00000100:00100000:1.0:1789264135.757960:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:10336:x1876179322720128:12345-0@lo:502: Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.757967:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789264135.758070:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10336:1876179322720128:0@lo:502: 00000040:00080000:3.0:1789264135.758092:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789264135.758244:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789264135.758271:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789264135.758280:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264135.758291:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264135.758301:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789264135.758304:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789264135.758307:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789264135.758328:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264135.758335:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264135.758344:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264135.758357:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322720256:0@lo:101: 00000100:00100000:2.0:1789264135.758386:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.758407:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.758458:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322720256 00000100:00100000:1.0:1789264135.758463:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322720256 00000100:00100000:1.0:1789264135.758492:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789264135.758499:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+16:6487:x1876179322720256:12345-0@lo:101: 00010000:00010000:1.0:1789264135.758507:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264135.758518:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed6c10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6c09 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.758537:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed6c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c09 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.758547:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed6c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c09 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.758555:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f095000, rc 0) 00000100:00100000:1.0:1789264135.758600:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322720256:12345-0@lo:101: Request processed in 101us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.758606:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789264135.758674:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322720256:0@lo:101: 00010000:00010000:2.0:1789264135.758686:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264135.758696:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264135.758735:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322720384:0@lo:501: 00000100:00100000:2.0:1789264135.758802:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.758818:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.758875:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322720384 00000100:00100000:0.0:1789264135.758879:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322720384 00000100:00100000:0.0:1789264135.758910:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789264135.758918:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322720384:12345-0@lo:501: 00000100:00100000:0.0:1789264135.759026:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322720384:12345-0@lo:501: Request processed in 109us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.759033:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789264135.759234:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322720384:0@lo:501: 00000100:00100000:2.0:1789264135.759260:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322720512:0@lo:503: 00000100:00100000:2.0:1789264135.759298:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.759321:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.759372:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322720512 00000100:00100000:0.0:1789264135.759376:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322720512 00000100:00100000:0.0:1789264135.759392:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789264135.759397:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322720512:12345-0@lo:503: 00000100:00100000:0.0:1789264135.759476:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322720512:12345-0@lo:503: Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.759482:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789264135.759553:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322720512:0@lo:503: 00000100:00100000:1.0:1789264135.761438:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10337:1876179322720640:0@lo:502: 00000100:00100000:1.0:1789264135.761512:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.761557:0:10337:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398304f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264135.761844:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322720640 00000100:00100000:3.0:1789264135.761850:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322720640 00000100:00100000:3.0:1789264135.761892:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789264135.761900:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:10337:x1876179322720640:12345-0@lo:502: 00000100:00100000:3.0:1789264135.762012:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:10337:x1876179322720640:12345-0@lo:502: Request processed in 112us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264135.762019:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789264135.762213:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10337:1876179322720640:0@lo:502: 00000020:01000000:1.0:1789264135.762247:0:10337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789264135.762255:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264135.762258:0:10337:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789264135.762263:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789264135.762287:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10337:1876179322720768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264135.762322:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.762350:0:10337:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398304f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264135.762397:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322720768 00000100:00100000:3.0:1789264135.762402:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322720768 00000100:00100000:3.0:1789264135.762434:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789264135.762443:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:10337:x1876179322720768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264135.762515:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:10337:x1876179322720768:12345-0@lo:502:llog_process_th.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264135.762522:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789264135.764795:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10337:1876179322720768:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789264135.764840:0:10337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264135.764847:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264135.764850:0:10337:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789264135.764854:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1789264135.765008:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789264135.765035:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789264135.765046:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.765056:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264135.765066:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789264135.765068:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3aba913000 from 48 10000000:01000000:0.0:1789264135.765071:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789264135.765101:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.765108:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.765118:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264135.765149:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322720896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.765203:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.765240:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.765290:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322720896 00000100:00100000:1.0:1789264135.765296:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322720896 00000100:00100000:1.0:1789264135.765352:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789264135.765361:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+17:6487:x1876179322720896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789264135.765372:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264135.765384:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f094800/0xecaf9f2f14ed6c1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6c17 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.765405:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f094800/0xecaf9f2f14ed6c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c17 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.765416:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f094800/0xecaf9f2f14ed6c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c17 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.765424:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f094800, rc 0) 00000100:00100000:1.0:1789264135.765460:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322720896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.765479:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789264135.765558:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322720896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264135.765571:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.765586:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264135.765638:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322721024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.765664:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.765689:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.767383:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322721024 00000100:00100000:1.0:1789264135.767393:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322721024 00000100:00100000:1.0:1789264135.767431:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789264135.767441:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322721024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789264135.767581:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322721024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.767588:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789264135.767678:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322721024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.767722:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322721152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.767797:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.767827:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.768003:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322721152 00000100:00100000:1.0:1789264135.768008:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322721152 00000100:00100000:1.0:1789264135.768038:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789264135.768045:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322721152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789264135.768122:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322721152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.768138:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789264135.768219:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322721152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.770149:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10339:1876179322721280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.770214:0:10339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.770256:0:10339:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.770306:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322721280 00000100:00100000:1.0:1789264135.770312:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322721280 00000100:00100000:1.0:1789264135.770361:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789264135.770370:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:10339:x1876179322721280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264135.770475:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:10339:x1876179322721280:12345-0@lo:502:llog_process_th.0 Request processed in 106us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.770483:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789264135.770600:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10339:1876179322721280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.770643:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10339:1876179322721408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.770680:0:10339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.770702:0:10339:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.770815:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322721408 00000100:00100000:1.0:1789264135.770819:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322721408 00000100:00100000:1.0:1789264135.770849:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789264135.770856:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:10339:x1876179322721408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264135.770924:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:10339:x1876179322721408:12345-0@lo:502:llog_process_th.0 Request processed in 68us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.770931:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789264135.771008:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10339:1876179322721408:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789264135.771028:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789264135.771184:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789264135.771203:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789264135.771212:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.771222:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264135.771232:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789264135.771234:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789264135.771237:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789264135.771261:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.771269:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.771277:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.771291:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322721536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789264135.771320:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.771409:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c49a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.771450:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322721536 00000100:00100000:0.0:1789264135.771455:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322721536 00000100:00100000:0.0:1789264135.771488:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789264135.771504:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+18:6487:x1876179322721536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264135.771513:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264135.771525:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a80030000/0xecaf9f2f14ed6c2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6c25 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.771546:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a80030000/0xecaf9f2f14ed6c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c25 expref: 19 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.771556:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a80030000/0xecaf9f2f14ed6c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c25 expref: 19 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.771564:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a80030000, rc 0) 00000100:00100000:0.0:1789264135.771594:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:6487:x1876179322721536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.771599:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789264135.771631:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322721536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264135.771643:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.771652:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264135.771695:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322721664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.771822:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.771839:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.771852:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322721664 00000100:00100000:0.0:1789264135.771855:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322721664 00000100:00100000:0.0:1789264135.771878:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789264135.771891:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:6487:x1876179322721664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.771991:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:6487:x1876179322721664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.771997:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789264135.772027:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322721664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.772052:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322721792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.772088:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.772101:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.772110:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322721792 00000100:00100000:0.0:1789264135.772114:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322721792 00000100:00100000:0.0:1789264135.772147:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789264135.772153:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:6487:x1876179322721792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.772229:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:6487:x1876179322721792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.772236:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789264135.772274:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322721792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264135.775078:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10340:1876179322721920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264135.775168:0:10340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264135.775209:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a3240 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.775374:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322721920 00000100:00100000:0.0:1789264135.775381:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322721920 00000100:00100000:0.0:1789264135.778370:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789264135.778391:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:10340:x1876179322721920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.778580:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:10340:x1876179322721920:12345-0@lo:502:llog_process_th.0 Request processed in 197us (3412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.778588:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789264135.779511:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10340:1876179322721920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789264135.779548:0:10340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264135.779558:0:10340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264135.779560:0:10340:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789264135.779565:0:10340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789264135.779596:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10340:1876179322722048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264135.779649:0:10340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264135.788840:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a3240 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.789456:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322722048 00000100:00100000:1.0:1789264135.789466:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322722048 00000100:00100000:1.0:1789264135.789596:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789264135.789613:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:10340:x1876179322722048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264135.790618:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:10340:x1876179322722048:12345-0@lo:502:llog_process_th.0 Request processed in 1001us (10962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.790628:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789264135.790826:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10340:1876179322722048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789264135.790862:0:10340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264135.790870:0:10340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264135.790872:0:10340:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789264135.790877:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1789264135.798385:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789264135.798418:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789264135.798430:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.798441:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264135.798450:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789264135.798452:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3aae2b1800 from 48 10000000:01000000:1.0:1789264135.798455:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789264135.798488:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.798495:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.798505:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.798528:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322722176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789264135.798589:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.798627:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c49a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.798645:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322722176 00000100:00100000:1.0:1789264135.798651:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322722176 00000100:00100000:1.0:1789264135.798705:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789264135.798715:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:6487:x1876179322722176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789264135.798727:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264135.798739:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f095c00/0xecaf9f2f14ed6c3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6c33 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.798781:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f095c00/0xecaf9f2f14ed6c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c33 expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.798791:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f095c00/0xecaf9f2f14ed6c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c33 expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.798799:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f095c00, rc 0) 00000100:00100000:1.0:1789264135.798836:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322722176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.798842:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789264135.798887:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322722176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789264135.798900:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.798909:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.798967:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322722304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789264135.798996:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.799013:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c49a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.799027:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322722304 00000100:00100000:1.0:1789264135.799030:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322722304 00000100:00100000:1.0:1789264135.799056:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789264135.799062:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322722304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789264135.799237:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322722304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.799244:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789264135.799269:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322722304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789264135.799292:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322722432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789264135.799331:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.799345:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c49a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.799356:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322722432 00000100:00100000:1.0:1789264135.799359:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322722432 00000100:00100000:1.0:1789264135.799376:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789264135.799381:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322722432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789264135.799458:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322722432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.799464:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789264135.799502:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322722432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.799898:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10344:1876179322722560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.799944:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.799971:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.800016:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322722560 00000100:00100000:1.0:1789264135.800020:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322722560 00000100:00100000:1.0:1789264135.800054:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789264135.800061:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:10344:x1876179322722560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264135.800152:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:10344:x1876179322722560:12345-0@lo:502:llog_process_th.0 Request processed in 91us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.800159:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789264135.800198:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10344:1876179322722560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264135.800242:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10344:1876179322722688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264135.800274:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.800287:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a964b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.800342:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322722688 00000100:00100000:0.0:1789264135.800346:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322722688 00000100:00100000:0.0:1789264135.800377:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789264135.800384:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:10344:x1876179322722688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.800450:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:10344:x1876179322722688:12345-0@lo:502:llog_process_th.0 Request processed in 66us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.800457:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789264135.800714:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10344:1876179322722688:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789264135.800734:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789264135.803704:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789264135.803810:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789264135.803822:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.803834:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264135.803844:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789264135.803847:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1789264135.803849:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789264135.803885:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.803894:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.803904:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264135.803928:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322722816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.803997:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.804042:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.804936:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322722816 00000100:00100000:1.0:1789264135.804946:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322722816 00000100:00100000:1.0:1789264135.804991:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789264135.805001:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322722816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789264135.805026:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264135.805041:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f094e00/0xecaf9f2f14ed6c48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6c41 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.805063:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f094e00/0xecaf9f2f14ed6c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c41 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.805074:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f094e00/0xecaf9f2f14ed6c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c41 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.805082:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f094e00, rc 0) 00000100:00100000:1.0:1789264135.805155:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322722816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.805162:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789264135.805548:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322722816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264135.805566:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.805576:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264135.805642:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322722944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.805676:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.805706:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.805733:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322722944 00000100:00100000:0.0:1789264135.805737:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322722944 00000100:00100000:0.0:1789264135.805777:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789264135.805785:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322722944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.805890:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322722944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.805897:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789264135.805928:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322722944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.805956:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322723072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.806004:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.806016:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab090c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.806026:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322723072 00000100:00100000:0.0:1789264135.806029:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322723072 00000100:00100000:0.0:1789264135.806043:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789264135.806055:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322723072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.806221:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322723072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.806227:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789264135.806265:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322723072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.806465:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10345:1876179322723200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.806497:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.806515:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322723200 00000100:00100000:0.0:1789264135.806518:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322723200 00000100:00100000:0.0:1789264135.806536:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789264135.806543:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:10345:x1876179322723200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.806613:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:10345:x1876179322723200:12345-0@lo:502:llog_process_th.0 Request processed in 70us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.806619:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789264135.806646:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab09cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.806657:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10345:1876179322723200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789264135.806678:0:10345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789264135.806687:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264135.806689:0:10345:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789264135.806695:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789264135.807686:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10345:1876179322723328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.807920:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.807948:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322723328 00000100:00100000:0.0:1789264135.807954:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322723328 00000100:00100000:0.0:1789264135.807985:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789264135.807993:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:10345:x1876179322723328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.808094:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:10345:x1876179322723328:12345-0@lo:502:llog_process_th.0 Request processed in 101us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.808102:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789264135.808160:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.808178:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10345:1876179322723328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789264135.808203:0:10345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264135.808209:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264135.808211:0:10345:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789264135.808216:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1789264135.808274:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1789264135.808290:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789264135.808300:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.808310:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264135.808321:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789264135.808508:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3a89eb9800 from 48 10000000:01000000:0.0:1789264135.808515:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789264135.808545:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.808553:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.808563:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264135.808591:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322723456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.808619:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.808677:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.810198:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322723456 00000100:00100000:1.0:1789264135.810208:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322723456 00000100:00100000:1.0:1789264135.810288:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789264135.810298:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322723456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789264135.810318:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264135.810412:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f095e00/0xecaf9f2f14ed6c56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6c4f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.810438:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f095e00/0xecaf9f2f14ed6c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c4f expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.810449:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f095e00/0xecaf9f2f14ed6c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c4f expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.810457:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f095e00, rc 0) 00000100:00100000:1.0:1789264135.810525:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322723456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.810532:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789264135.810609:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322723456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789264135.810626:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264135.810636:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264135.810708:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322723584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789264135.811056:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.811354:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.811543:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322723584 00000100:00100000:0.0:1789264135.811549:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322723584 00000100:00100000:0.0:1789264135.811576:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789264135.811583:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322723584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.811708:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322723584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.811715:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789264135.811833:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322723584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789264135.811868:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322723712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789264135.811909:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.811933:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.812056:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322723712 00000100:00100000:0.0:1789264135.812061:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322723712 00000100:00100000:0.0:1789264135.812081:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789264135.812087:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322723712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.812184:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322723712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.812191:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789264135.812258:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322723712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789264135.812686:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10347:1876179322723840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789264135.812994:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.813076:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.813108:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322723840 00000100:00100000:0.0:1789264135.813113:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322723840 00000100:00100000:0.0:1789264135.813183:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789264135.813192:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:10347:x1876179322723840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.813301:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:10347:x1876179322723840:12345-0@lo:502:llog_process_th.0 Request processed in 109us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.813309:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789264135.813379:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10347:1876179322723840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789264135.813425:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10347:1876179322723968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789264135.813461:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264135.813616:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789264135.813646:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322723968 00000100:00100000:1.0:1789264135.813651:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322723968 00000100:00100000:1.0:1789264135.813675:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789264135.813682:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:10347:x1876179322723968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264135.813945:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:10347:x1876179322723968:12345-0@lo:502:llog_process_th.0 Request processed in 263us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.813952:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789264135.814101:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10347:1876179322723968:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789264135.814140:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789264135.818323:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789264135.818370:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789264135.818381:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.818393:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264135.818403:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789264135.818405:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1789264135.818408:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789264135.818440:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.818449:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.818459:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264135.818483:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322724096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.818543:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.818631:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308fb40 going to sleep for 11 seconds 00010000:00010000:0.0:1789264135.818678:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264135.820877:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322724096 00000100:00100000:1.0:1789264135.820892:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322724096 00000100:00100000:2.0:1789264135.821074:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789264135.821086:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322724096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789264135.821100:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264135.821116:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5623800/0xecaf9f2f14ed6c64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6c5d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264135.821154:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5623800/0xecaf9f2f14ed6c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c5d expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264135.821166:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5623800/0xecaf9f2f14ed6c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c5d expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264135.821176:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623800, rc 0) 00000100:00100000:2.0:1789264135.821243:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322724096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264135.821249:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789264135.821334:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322724096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264135.821351:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.821361:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264135.821438:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322724224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.821470:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.821506:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.821520:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322724224 00000100:00100000:0.0:1789264135.821524:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322724224 00000100:00100000:0.0:1789264135.821544:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789264135.821550:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322724224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.821647:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322724224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.821653:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789264135.821683:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322724224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.821707:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322724352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.821781:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.821795:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.821807:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322724352 00000100:00100000:0.0:1789264135.821811:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322724352 00000100:00100000:0.0:1789264135.821827:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789264135.821832:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322724352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.821910:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322724352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.821917:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789264135.821955:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322724352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.822158:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10349:1876179322724480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.822195:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.822214:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322724480 00000100:00100000:0.0:1789264135.822218:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322724480 00000100:00100000:0.0:1789264135.822233:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789264135.822238:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:10349:x1876179322724480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.822300:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:10349:x1876179322724480:12345-0@lo:502:llog_process_th.0 Request processed in 61us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.822306:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789264135.822330:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.822342:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10349:1876179322724480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789264135.822361:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789264135.822368:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264135.822370:0:10349:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789264135.822375:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789264135.822391:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10349:1876179322724608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.822422:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.822440:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322724608 00000100:00100000:0.0:1789264135.822444:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322724608 00000100:00100000:0.0:1789264135.822460:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789264135.822466:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:10349:x1876179322724608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264135.822523:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:10349:x1876179322724608:12345-0@lo:502:llog_process_th.0 Request processed in 57us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.822530:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789264135.822553:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.822564:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10349:1876179322724608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789264135.822578:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264135.822586:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264135.822587:0:10349:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789264135.822591:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789264135.822627:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1789264135.822641:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789264135.822648:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.822657:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264135.822667:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789264135.822669:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c3aaa494d28 from 1 10000000:01000000:0.0:1789264135.822672:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789264135.822690:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031a00/0xecaf9f2f14ed6c6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.822697:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a80031a00/0xecaf9f2f14ed6c6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.822705:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a80031a00/0xecaf9f2f14ed6c6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264135.822717:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322724736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.822740:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.822772:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.822782:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322724736 00000100:00100000:0.0:1789264135.822785:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322724736 00000100:00100000:0.0:1789264135.822800:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789264135.822805:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322724736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264135.822819:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264135.822829:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6c72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6c6b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.822847:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c6b expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.822855:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c6b expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.822863:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a80030400, rc 0) 00000100:00100000:0.0:1789264135.822891:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322724736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264135.822897:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789264135.822926:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322724736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264135.822936:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a80031a00/0xecaf9f2f14ed6c6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264135.822944:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a80031a00/0xecaf9f2f14ed6c6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264135.822979:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322724864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.825269:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264135.825308:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789264135.825330:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322724864 00000100:00100000:0.0:1789264135.825335:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322724864 00000100:00100000:0.0:1789264135.825370:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789264135.825380:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322724864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264135.825618:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322724864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (350us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789264135.825627:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789264135.825827:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322724864:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789264135.825866:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789264135.825875:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031a00/0xecaf9f2f14ed6c6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264135.825893:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a80031a00/0xecaf9f2f14ed6c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789264135.910060:0:10362:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5888e8d0 20000000:00000080:1.0:1789264135.910078:0:10362:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c3abad79000 uarg=0000000000000000 20000000:01000000:1.0:1789264135.910139:0:10362:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789264135.910144:0:10362:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789264135.910148:0:10362:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789264135.910726:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789264135.911023:0:10362:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789264135.918827:0:10362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789264135.918862:0:10362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789264135.918890:0:10362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789264135.918912:0:10362:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789264135.918930:0:10362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.918948:0:10362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3ab5622400/0xecaf9f2f14ed68c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed68ba expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.918957:0:10362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6915 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed690e expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.918964:0:10362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a80030600/0xecaf9f2f14ed6977 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6970 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.918970:0:10362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6a9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6a96 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.918980:0:10362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3ab5623000/0xecaf9f2f14ed6bb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda964 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.918986:0:10362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919025:0:10362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3ab5623000/0xecaf9f2f14ed6bb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda964 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919040:0:10362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3ab5623000/0xecaf9f2f14ed6bb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda964 expref: 9 pid: 6482 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.919070:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10362:1876179322724992:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264135.919183:0:10362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6a9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6a96 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919192:0:10362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6a9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a96 expref: 23 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.919201:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10362:1876179322725120:0@lo:104: 00000100:00100000:1.0:1789264135.919238:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.919294:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322725120 00000100:00100000:1.0:1789264135.919302:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322725120 00000100:00100000:1.0:1789264135.919346:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789264135.919356:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:10362:x1876179322725120:12345-0@lo:104: 00010000:00010000:1.0:1789264135.919368:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6a9d expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919419:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789264135.919425:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:10362:x1876179322725120:12345-0@lo:104: Request processed in 71us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.919432:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1789264135.919467:0:10362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a80030600/0xecaf9f2f14ed6977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6970 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919476:0:10362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a80030600/0xecaf9f2f14ed6977 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6970 expref: 23 pid: 6485 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.919484:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10362:1876179322725248:0@lo:104: 00000100:00100000:1.0:1789264135.919517:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.919541:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789264135.919550:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322725248 00000100:00100000:1.0:1789264135.919553:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322725248 00000100:00100000:1.0:1789264135.919573:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789264135.919580:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983689c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:10362:x1876179322725248:12345-0@lo:104: 00010000:00010000:1.0:1789264135.919587:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6977 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919621:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789264135.919626:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983689c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:10362:x1876179322725248:12345-0@lo:104: Request processed in 47us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.919632:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1789264135.919664:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789264135.919670:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6a9d expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919677:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264135.919681:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6a9d expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919689:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6a9d expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264135.919696:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6a9d expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264135.919702:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789264135.919726:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a9d expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919772:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264135.919794:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a9d expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919801:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b000/0xecaf9f2f14ed6a96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6a9d expref: -99 pid: 9480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919816:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264135.919819:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6977 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919824:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8f095a00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264135.919827:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6977 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919834:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6977 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264135.919840:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6977 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264135.919846:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789264135.919859:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6977 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919864:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264135.919879:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6977 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919886:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095a00/0xecaf9f2f14ed6970 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6977 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.919904:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264135.919905:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264135.919907:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264135.919916:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789264135.919927:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322725376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264135.919955:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.919986:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322725504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264135.920006:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.920034:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322725376 00000100:00100000:1.0:1789264135.920037:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322725376 00010000:00010000:1.0:1789264135.920054:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6a9d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a96 expref: 24 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.920072:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322725504 00000100:00100000:1.0:1789264135.920076:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322725504 00010000:00010000:1.0:1789264135.920086:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a80030600/0xecaf9f2f14ed6977 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6970 expref: 25 pid: 6485 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.920102:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789264135.920108:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+25:3622:x1876179322725376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789264135.920118:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264135.920135:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6a9d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a96 expref: 25 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920144:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6a9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a96 expref: 25 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920159:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264135.920194:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+25:3622:x1876179322725376:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.920201:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789264135.920215:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789264135.920221:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322725504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789264135.920228:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264135.920232:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a80030600/0xecaf9f2f14ed6977 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6970 expref: 24 pid: 6485 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920239:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a80030600/0xecaf9f2f14ed6977 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6970 expref: 24 pid: 6485 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920250:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264135.920274:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322725504:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.920280:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789264135.920312:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322725376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264135.920334:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322725504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789264135.920357:0:10362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed690e expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920366:0:10362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6915 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed690e expref: 23 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.920375:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10362:1876179322725632:0@lo:104: 00000100:00100000:1.0:1789264135.920396:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.920415:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322725632 00000100:00100000:1.0:1789264135.920418:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322725632 00000100:00100000:1.0:1789264135.920444:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789264135.920449:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:10362:x1876179322725632:12345-0@lo:104: 00010000:00010000:1.0:1789264135.920457:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6915 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920487:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789264135.920492:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:10362:x1876179322725632:12345-0@lo:104: Request processed in 43us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.920497:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1789264135.920523:0:10362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3ab5622400/0xecaf9f2f14ed68c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed68ba expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920531:0:10362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3ab5622400/0xecaf9f2f14ed68c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68ba expref: 23 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.920538:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10362:1876179322725760:0@lo:104: 00000100:00100000:1.0:1789264135.920556:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.920570:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322725760 00000100:00100000:1.0:1789264135.920573:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322725760 00000100:00100000:1.0:1789264135.920589:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789264135.920593:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:10362:x1876179322725760:12345-0@lo:104: 00010000:00010000:1.0:1789264135.920600:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed68ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed68c1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920624:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789264135.920628:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:10362:x1876179322725760:12345-0@lo:104: Request processed in 35us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.920633:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1789264135.920645:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789264135.920654:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6915 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920661:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b400 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264135.920664:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6915 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920671:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6915 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264135.920677:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6915 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264135.920682:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789264135.920697:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6915 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920702:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264135.920712:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6915 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920718:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed690e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6915 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920726:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264135.920730:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed68ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed68c1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920735:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264135.920738:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed68ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed68c1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920777:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed68ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed68c1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264135.920784:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed68ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed68c1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264135.920789:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789264135.920801:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed68ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68c1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920806:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264135.920814:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed68ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68c1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920821:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed68ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed68c1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.920832:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264135.920834:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264135.920835:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264135.920840:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789264135.920848:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322725888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264135.920871:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.920899:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322726016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264135.920921:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264135.920943:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322725888 00000100:00100000:1.0:1789264135.920947:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322725888 00010000:00010000:1.0:1789264135.920974:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6915 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed690e expref: 24 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.921000:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322726016 00000100:00100000:1.0:1789264135.921003:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322726016 00010000:00010000:1.0:1789264135.921014:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3ab5622400/0xecaf9f2f14ed68c1 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68ba expref: 25 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.921025:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789264135.921031:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+25:3624:x1876179322725888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789264135.921038:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264135.921043:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6915 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed690e expref: 25 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.921050:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6915 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed690e expref: 25 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.921061:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264135.921088:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+25:3624:x1876179322725888:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.921094:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789264135.921105:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789264135.921111:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2786450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322726016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789264135.921117:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264135.921121:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3ab5622400/0xecaf9f2f14ed68c1 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68ba expref: 24 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.921141:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3ab5622400/0xecaf9f2f14ed68c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed68ba expref: 24 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.921151:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264135.921181:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2786450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322726016:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264135.921186:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789264135.921232:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322725888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264135.921250:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322726016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264135.921264:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c49a780 going to sleep for 11 seconds 00010000:00010000:1.0:1789264135.921276:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6a9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6a96 expref: 23 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.921285:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10362:1876179322725120:0@lo:104: 00010000:00010000:1.0:1789264135.921293:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a80030600/0xecaf9f2f14ed6977 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6970 expref: 22 pid: 6485 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.921300:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10362:1876179322725248:0@lo:104: 00010000:00010000:1.0:1789264135.921306:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6915 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed690e expref: 21 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.921312:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10362:1876179322725632:0@lo:104: 00010000:00010000:1.0:1789264135.921319:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5622400/0xecaf9f2f14ed68c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed68ba expref: 20 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.921327:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10362:1876179322725760:0@lo:104: 00010000:00010000:0.0:1789264135.922000:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264135.922026:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264135.928187:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264135.928263:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311138688 00000100:00100000:3.0:1789264135.928272:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311138688 00010000:00010000:3.0:1789264135.928314:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3ab5623000/0xecaf9f2f14ed6bb5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda964 expref: 10 pid: 6482 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264135.928386:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:3.0:1789264135.928396:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2402:x1876179311138688:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264135.928411:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264135.928416:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3ab5623000/0xecaf9f2f14ed6bb5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda964 expref: 10 pid: 6482 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264135.928428:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3ab5623000/0xecaf9f2f14ed6bb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda964 expref: 10 pid: 6482 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264135.928449:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264135.928457:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264135.928471:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264135.928478:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264135.928497:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264135.928504:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264135.928510:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8f094200 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264135.928514:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264135.928563:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264135.928575:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264135.928586:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264135.928634:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2402:x1876179311138688:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 240us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264135.928642:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 39 00010000:00010000:1.0:1789264135.928718:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5623000/0xecaf9f2f14ed6bb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda964 expref: 9 pid: 6482 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264135.928732:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10362:1876179322724992:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264135.928780:0:10362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.928795:0:10362:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.928802:0:10362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264135.928808:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6c79 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264136.526575:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264136.526650:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311138816 00000100:00100000:3.0:1789264136.526661:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311138816 00000100:00100000:3.0:1789264136.526771:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 242 00000100:00100000:3.0:1789264136.526782:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:6166:x1876179311138816:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264136.526796:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264136.526814:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6c80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bda9aa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264136.526839:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9aa expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264136.526872:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9aa expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264136.526887:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36bc00, rc 0) 00000100:00100000:3.0:1789264136.526939:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6166:x1876179311138816:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 160us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264136.526946:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 242 00000100:00100000:2.0:1789264136.530847:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264136.531189:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311138944 00000100:00100000:0.0:1789264136.531198:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311138944 00000100:00100000:0.0:1789264136.531248:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 243 00000100:00100000:0.0:1789264136.531258:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6166:x1876179311138944:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264136.531403:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6166:x1876179311138944:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 145us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264136.531411:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 243 00000100:00100000:1.0:1789264136.535668:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264136.535773:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311139072 00000100:00100000:2.0:1789264136.535783:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311139072 00000100:00100000:2.0:1789264136.535841:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 244 00000100:00100000:2.0:1789264136.535853:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6166:x1876179311139072:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789264136.536016:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6166:x1876179311139072:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 Request processed in 165us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264136.536036:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 244 00000100:00100000:3.0:1789264136.541845:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264136.542107:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311139200 00000100:00100000:2.0:1789264136.542116:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311139200 00000100:00100000:2.0:1789264136.542183:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 245 00000100:00100000:2.0:1789264136.542194:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6697:x1876179311139200:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789264136.542326:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6697:x1876179311139200:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 132us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264136.542334:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 245 00000100:00100000:0.0:1789264136.546294:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264136.546375:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311139328 00000100:00100000:2.0:1789264136.546385:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311139328 00000100:00100000:2.0:1789264136.546445:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 246 00000100:00100000:2.0:1789264136.546456:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6697:x1876179311139328:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789264136.546604:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:6697:x1876179311139328:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 150us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264136.546619:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 246 00010000:00010000:1.0:1789264136.841877:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789264137.609825:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789264137.609832:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3ab7f50000 from 4 10000000:01000000:2.0:1789264137.609837:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789264137.609889:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264137.609902:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264137.609913:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264137.609938:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322726144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789264137.610006:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264137.610058:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264137.610658:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322726144 00000100:00100000:1.0:1789264137.610667:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322726144 00000100:00100000:0.0:1789264137.610834:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789264137.610847:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322726144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264137.610861:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264137.610875:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ac216c400/0xecaf9f2f14ed6c8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6c87 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264137.610900:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ac216c400/0xecaf9f2f14ed6c8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c87 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264137.610911:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ac216c400/0xecaf9f2f14ed6c8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c87 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264137.610921:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ac216c400, rc 0) 00000100:00100000:0.0:1789264137.610991:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322726144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264137.610998:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789264137.611081:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322726144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789264137.611096:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264137.611108:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264137.611183:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322726272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789264137.611215:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264137.611241:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8922cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789264137.611257:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322726272 00000100:00100000:1.0:1789264137.611261:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322726272 00000100:00100000:1.0:1789264137.611295:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789264137.611307:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322726272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789264137.611566:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322726272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264137.611573:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789264137.611604:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322726272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789264137.611631:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322726400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789264137.611672:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264137.611686:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8922cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789264137.611698:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322726400 00000100:00100000:1.0:1789264137.611701:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322726400 00000100:00100000:1.0:1789264137.611724:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789264137.611730:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322726400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789264137.611833:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322726400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264137.611840:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789264137.611881:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322726400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789264137.612217:0:10470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10470:1876179322726528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264137.612255:0:10470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264137.612277:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322726528 00000100:00100000:1.0:1789264137.612281:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322726528 00000100:00100000:1.0:1789264137.612304:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789264137.612311:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:10470:x1876179322726528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264137.612522:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:10470:x1876179322726528:12345-0@lo:502:llog_process_th.0 Request processed in 211us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264137.612528:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789264137.612565:0:10470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8922cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789264137.612579:0:10470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10470:1876179322726528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789264137.612598:0:10470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789264137.612605:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264137.612607:0:10470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789264137.612614:0:10470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c3ab7f50000 00000020:00000080:1.0:1789264137.612616:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789264137.615650:0:10470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10470:1876179322726656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264137.615730:0:10470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264137.615843:0:10470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa454a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789264137.618837:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322726656 00000100:00100000:2.0:1789264137.618851:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322726656 00000100:00100000:2.0:1789264137.618914:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789264137.618927:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:10470:x1876179322726656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789264137.619096:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:10470:x1876179322726656:12345-0@lo:502:llog_process_th.0 Request processed in 168us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264137.619104:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789264137.619283:0:10470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10470:1876179322726656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789264137.619319:0:10470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264137.619327:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264137.619329:0:10470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789264137.619336:0:10470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789264137.619786:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789264137.619807:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789264137.619817:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264137.619840:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264137.619850:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789264137.619852:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3aba913000 from 4 10000000:01000000:2.0:1789264137.619855:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789264137.619890:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264137.619897:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264137.619907:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264137.619927:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322726784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789264137.619968:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264137.619997:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789264137.620054:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322726784 00000100:00100000:3.0:1789264137.620060:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322726784 00000100:00100000:3.0:1789264137.620101:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789264137.620110:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322726784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264137.620129:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264137.620142:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed6c9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6c95 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.620164:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed6c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c95 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.620175:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed6c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c95 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.620184:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a600, rc 0) 00000100:00100000:3.0:1789264137.620223:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322726784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.620229:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789264137.620264:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322726784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264137.620285:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.620294:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264137.620358:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322726912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.620384:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264137.620397:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789264137.620411:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322726912 00000100:00100000:3.0:1789264137.620415:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322726912 00000100:00100000:3.0:1789264137.620439:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789264137.620447:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322726912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.620550:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322726912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.620557:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789264137.620593:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322726912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.620621:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322727040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.620657:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264137.620670:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789264137.620682:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322727040 00000100:00100000:3.0:1789264137.620685:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322727040 00000100:00100000:3.0:1789264137.620707:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789264137.620713:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aaa0bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322727040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.620822:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aaa0bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322727040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.620838:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789264137.620878:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322727040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.621070:0:10473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10473:1876179322727168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264137.621102:0:10473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264137.621132:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322727168 00000100:00100000:3.0:1789264137.621136:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322727168 00000100:00100000:3.0:1789264137.621157:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789264137.621165:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aaa0b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:10473:x1876179322727168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264137.621233:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aaa0b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:10473:x1876179322727168:12345-0@lo:502:llog_process_th.0 Request processed in 68us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.621239:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789264137.621268:0:10473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264137.621280:0:10473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10473:1876179322727168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789264137.621301:0:10473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264137.621311:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264137.621314:0:10473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789264137.621321:0:10473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c3aba913000 00000020:00000080:3.0:1789264137.621325:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789264137.621783:0:10473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10473:1876179322727296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264137.621821:0:10473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264137.621845:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322727296 00000100:00100000:3.0:1789264137.621849:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322727296 00000100:00100000:3.0:1789264137.621875:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789264137.621883:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:10473:x1876179322727296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264137.621955:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:10473:x1876179322727296:12345-0@lo:502:llog_process_th.0 Request processed in 73us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.621969:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789264137.622002:0:10473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264137.622016:0:10473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10473:1876179322727296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789264137.622038:0:10473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264137.622043:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264137.622046:0:10473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789264137.622050:0:10473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789264137.622104:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789264137.622140:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789264137.622149:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.622159:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264137.622169:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789264137.622172:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3aae2b1800 from 4 10000000:01000000:3.0:1789264137.622175:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789264137.622196:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.622204:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.622212:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264137.622225:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322727424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.622251:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264137.622272:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264137.622283:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322727424 00000100:00100000:3.0:1789264137.622287:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322727424 00000100:00100000:3.0:1789264137.622309:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789264137.622316:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322727424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264137.622322:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264137.622333:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36b200/0xecaf9f2f14ed6caa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6ca3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.622351:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36b200/0xecaf9f2f14ed6caa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6ca3 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.622360:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36b200/0xecaf9f2f14ed6caa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6ca3 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.622368:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b200, rc 0) 00000100:00100000:3.0:1789264137.622395:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322727424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.622401:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789264137.622431:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322727424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264137.622442:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6caa expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.622450:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6caa expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264137.622483:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322727552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.622505:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264137.622525:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264137.622537:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322727552 00000100:00100000:3.0:1789264137.622540:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322727552 00000100:00100000:3.0:1789264137.622568:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789264137.622575:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322727552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.622653:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322727552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.622660:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789264137.622689:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322727552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.622713:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322727680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.622768:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264137.622782:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264137.622795:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322727680 00000100:00100000:3.0:1789264137.622798:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322727680 00000100:00100000:3.0:1789264137.622820:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789264137.622827:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322727680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.622891:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322727680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.622899:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789264137.622941:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322727680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789264137.627598:0:10474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac60a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10474:1876179322727808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789264137.627832:0:10474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264137.627875:0:10474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264137.628226:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322727808 00000100:00100000:3.0:1789264137.628234:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322727808 00000100:00100000:3.0:1789264137.628830:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789264137.628845:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:10474:x1876179322727808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264137.628988:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:10474:x1876179322727808:12345-0@lo:502:llog_process_th.0 Request processed in 148us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.629003:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789264137.630815:0:10474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac60a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10474:1876179322727808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789264137.630861:0:10474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264137.630872:0:10474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264137.630874:0:10474:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789264137.630881:0:10474:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c3aae2b1800 00000020:00000080:3.0:1789264137.638931:0:10474:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789264137.639253:0:10474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10474:1876179322727936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264137.639323:0:10474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264137.639375:0:10474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789264137.639521:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322727936 00000100:00100000:2.0:1789264137.639534:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322727936 00000100:00100000:2.0:1789264137.639584:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789264137.639593:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:10474:x1876179322727936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789264137.640512:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:10474:x1876179322727936:12345-0@lo:502:llog_process_th.0 Request processed in 917us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264137.640521:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789264137.643466:0:10474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10474:1876179322727936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789264137.643570:0:10474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264137.643578:0:10474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264137.643581:0:10474:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789264137.643586:0:10474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789264137.643668:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789264137.643693:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789264137.643703:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6caa expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.643715:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6caa expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264137.643725:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789264137.643728:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3a89eb9800 from 4 10000000:01000000:3.0:1789264137.643732:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789264137.643785:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.643794:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.643804:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264137.643837:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322728064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.643899:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264137.643930:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264137.643946:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322728064 00000100:00100000:3.0:1789264137.643952:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322728064 00000100:00100000:3.0:1789264137.643989:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789264137.643998:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322728064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264137.644010:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264137.644023:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6cb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6cb1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.644044:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6cb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6cb1 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.644055:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6cb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6cb1 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.644064:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a800, rc 0) 00000100:00100000:3.0:1789264137.644101:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322728064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.644108:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789264137.644155:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322728064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264137.644167:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.644178:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264137.644241:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322728192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.644269:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264137.644283:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264137.644294:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322728192 00000100:00100000:3.0:1789264137.644297:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322728192 00000100:00100000:3.0:1789264137.644321:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789264137.644327:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322728192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.644421:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322728192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.644428:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789264137.644458:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322728192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.644488:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322728320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.644531:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264137.644544:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264137.644554:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322728320 00000100:00100000:3.0:1789264137.644558:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322728320 00000100:00100000:3.0:1789264137.644583:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789264137.644590:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322728320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.644668:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322728320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.644675:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789264137.644714:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322728320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264137.644929:0:10477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10477:1876179322728448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264137.644965:0:10477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264137.644980:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322728448 00000100:00100000:3.0:1789264137.644983:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322728448 00000100:00100000:3.0:1789264137.645003:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789264137.645009:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:10477:x1876179322728448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264137.645071:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:10477:x1876179322728448:12345-0@lo:502:llog_process_th.0 Request processed in 61us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.645077:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789264137.645104:0:10477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264137.645127:0:10477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10477:1876179322728448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789264137.645146:0:10477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264137.645153:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264137.645156:0:10477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789264137.645162:0:10477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c3a89eb9800 00000020:00000080:3.0:1789264137.645164:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789264137.645439:0:10477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10477:1876179322728576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264137.645476:0:10477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264137.645495:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322728576 00000100:00100000:3.0:1789264137.645498:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322728576 00000100:00100000:3.0:1789264137.645522:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789264137.645529:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:10477:x1876179322728576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264137.645588:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:10477:x1876179322728576:12345-0@lo:502:llog_process_th.0 Request processed in 60us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.645595:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789264137.645625:0:10477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264137.645638:0:10477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:10477:1876179322728576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789264137.645668:0:10477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264137.645672:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264137.645674:0:10477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789264137.645677:0:10477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789264137.645719:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789264137.645733:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789264137.645740:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264137.645768:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264137.678907:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264137.678947:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264137.678973:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264137.678994:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264137.679022:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311139456 00000100:00100000:3.0:1789264137.679026:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264137.679034:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311139456 00000100:00100000:3.0:1789264137.679052:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311139712 00000100:00100000:3.0:1789264137.679058:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311139712 00000100:00100000:0.0:1789264137.679097:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 267 00000100:00100000:3.0:1789264137.679103:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311139584 00000100:00100000:3.0:1789264137.679108:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311139584 00000100:00100000:0.0:1789264137.679110:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2405:x1876179311139456:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264137.679145:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:3.0:1789264137.679160:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311139712:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264137.679192:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2405:x1876179311139456:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 84us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.679201:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311139712:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 47us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264137.679203:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 267 00000100:00100000:3.0:1789264137.679215:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:3.0:1789264137.679233:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:3.0:1789264137.679243:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2405:x1876179311139584:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264137.679283:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2405:x1876179311139584:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 42us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.679291:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:3.0:1789264137.679316:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311139968 00000100:00100000:3.0:1789264137.679321:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311139968 00000100:00100000:1.0:1789264137.680050:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311139840 00000100:00100000:1.0:1789264137.680056:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311139840 00000100:00100000:3.0:1789264137.680068:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:3.0:1789264137.680081:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311139968:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264137.680101:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:1.0:1789264137.680120:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311139840:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264137.680142:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311139968:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 65us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264137.680150:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:1.0:1789264137.680156:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311139840:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 46us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264137.680164:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00080000:3.0:1789264137.680180:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789264137.680185:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789264137.680187:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789264137.680189:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789264137.738047:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322728832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789264137.738126:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264137.738164:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322728704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789264137.738198:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264137.738553:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322728832 00000100:00100000:1.0:1789264137.738560:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322728832 00000100:00100000:1.0:1789264137.738605:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322728704 00000100:00100000:1.0:1789264137.738608:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322728704 00000100:00100000:1.0:1789264137.738624:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789264137.738633:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322728832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789264137.738672:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264137.739103:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322728832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 469us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264137.739121:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789264137.739139:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789264137.739146:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322728704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789264137.739156:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264137.739184:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322728704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264137.739189:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789264137.739205:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789264137.739300:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39837f3100 x1876179322728704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1789264137.739306:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398364f480 x1876179322728832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264137.739348:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322728704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789264137.739547:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322728832:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789264137.865909:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264138.252789:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322728960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789264138.252870:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264138.253019:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322728960 00000100:00100000:1.0:1789264138.253030:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322728960 00000100:00100000:1.0:1789264138.253100:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789264138.253120:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322728960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789264138.253162:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789264138.253215:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322728960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264138.253222:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789264138.253396:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322728960:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789264138.889888:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264139.913947:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789264140.148533:0:10662:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1789264140.298139:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322729088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789264140.298194:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322729216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789264140.298212:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264140.298314:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322729600:0@lo:400:kworker.0 00000100:00100000:0.0:1789264140.298345:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322729088 00000100:00100000:0.0:1789264140.298355:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322729088 00000100:00100000:1.0:1789264140.298363:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264140.298389:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322730112:0@lo:400:kworker.0 00000100:00100000:0.0:1789264140.298414:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789264140.298420:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264140.298429:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322729088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264140.298460:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322730624:0@lo:400:kworker.0 00002000:00000024:0.0:1789264140.298461:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264140.298516:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322729088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264140.298527:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789264140.298541:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322729344:0@lo:400:kworker.0 00000100:00100000:2.0:1789264140.298577:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264140.298609:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322729856:0@lo:400:kworker.0 00000100:00100000:0.0:1789264140.298625:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322729344 00000100:00100000:0.0:1789264140.298631:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322729344 00000100:00100000:2.0:1789264140.298637:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264140.298657:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322730368:0@lo:400:kworker.0 00000100:00100000:1.0:1789264140.298661:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264140.298664:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789264140.298689:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322729344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264140.298690:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264140.298714:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789264140.298721:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322729472:0@lo:400:kworker.0 00000100:00100000:0.0:1789264140.298734:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322729344:12345-0@lo:400:kworker.0 Request processed in 61us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264140.298766:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00080000:1.0:1789264140.298796:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac63100 x1876179322729088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264140.298816:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322729088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264140.298833:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789264140.298839:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322729728:0@lo:400:kworker.0 00000100:00100000:1.0:1789264140.298870:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322729600 00000100:00100000:1.0:1789264140.298874:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322729600 00000100:00100000:1.0:1789264140.298901:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322729856 00000100:00100000:1.0:1789264140.298905:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322729856 00000100:00100000:1.0:1789264140.298919:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789264140.298926:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322729600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264140.299245:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322730112 00000100:00100000:3.0:1789264140.299250:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322730112 00000100:00100000:1.0:1789264140.299329:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322729600:12345-0@lo:400:kworker.0 Request processed in 402us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264140.299353:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789264140.299369:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789264140.299374:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322729856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264140.299408:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322729856:12345-0@lo:400:kworker.0 Request processed in 34us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264140.299413:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1789264140.299429:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789264140.299434:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789264140.299475:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264140.302974:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322729984:0@lo:400:kworker.0 00000100:00100000:2.0:1789264140.303041:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264140.307432:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322730624 00000100:00100000:3.0:1789264140.307445:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322730624 00000100:00100000:3.0:1789264140.307643:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322729472 00000100:00100000:3.0:1789264140.307646:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322729472 00000100:00100000:3.0:1789264140.307664:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789264140.307674:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322730112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264140.308033:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322730112:12345-0@lo:400:kworker.0 Request processed in 361us (9614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264140.308041:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789264140.308056:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789264140.308062:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322730624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264140.308084:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322730624:12345-0@lo:400:kworker.0 Request processed in 23us (9595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264140.308089:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789264140.308111:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789264140.308117:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322729472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264140.308145:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322729472:12345-0@lo:400:kworker.0 Request processed in 29us (9376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264140.308151:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789264140.308175:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322730368 00000100:00100000:3.0:1789264140.308179:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322730368 00000100:00100000:3.0:1789264140.308216:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789264140.308223:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322730368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264140.308254:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322730368:12345-0@lo:400:kworker.0 Request processed in 32us (9567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264140.308260:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789264140.308282:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789264140.308285:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789264140.308298:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264140.309137:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322729216 00000100:00100000:3.0:1789264140.309145:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322729216 00000100:00100000:3.0:1789264140.309246:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789264140.309255:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322729216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789264140.309284:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264140.309331:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322729216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264140.309347:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789264140.309390:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39837f1500 x1876179322729216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264140.309411:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322729216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264140.309639:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1876179322730496:0@lo:400:kworker.0 00000100:00100000:2.0:1789264140.309690:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264140.309827:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322729344:0@lo:400:kworker.0 00000100:00100000:2.0:1789264140.309839:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322729856:0@lo:400:kworker.0 00010000:00080000:2.0:1789264140.309870:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac60380 x1876179322730368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264140.309878:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322730368:0@lo:400:kworker.0 00000100:00100000:2.0:1789264140.309900:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322729472:0@lo:400:kworker.0 00000100:00100000:3.0:1789264140.309955:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322729984 00000100:00100000:0.0:1789264140.309961:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322730496 00000100:00100000:3.0:1789264140.309969:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322729984 00000100:00100000:0.0:1789264140.309969:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322730496 00000100:00100000:2.0:1789264140.310317:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264140.310346:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322730240:0@lo:400:kworker.0 00000100:00100000:2.0:1789264140.310376:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264140.310395:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322730752:0@lo:400:kworker.0 00000100:00100000:2.0:1789264140.310431:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789264140.310459:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac61180 x1876179322730112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264140.310469:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322730112:0@lo:400:kworker.0 00010000:00080000:2.0:1789264140.310481:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac63480 x1876179322730624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264140.310489:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322730624:0@lo:400:kworker.0 00000100:00100000:2.0:1789264140.310507:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322729600:0@lo:400:kworker.0 00000100:00100000:2.0:1789264140.310532:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322730240 00000100:00100000:2.0:1789264140.310536:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322730240 00000100:00080000:1.0:1789264140.311214:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789264140.311221:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789264140.311223:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789264140.311527:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322729728 00000100:00100000:3.0:1789264140.311533:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322729728 00000100:00100000:3.0:1789264140.311647:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789264140.311658:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876179322729984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264140.312231:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876179322729984:12345-0@lo:400:kworker.0 Request processed in 573us (9187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264140.312239:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789264140.312352:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789264140.312364:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789264140.312365:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322729728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264140.312380:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1876179322730496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264140.312427:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1876179322730496:12345-0@lo:400:kworker.0 Request processed in 52us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264140.312434:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789264140.312563:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322729728:12345-0@lo:400:kworker.0 Request processed in 202us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264140.312570:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789264140.312721:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322729728:0@lo:400:kworker.0 00000100:00100000:1.0:1789264140.312826:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322729984:0@lo:400:kworker.0 00000100:00100000:1.0:1789264140.312858:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1876179322730496:0@lo:400:kworker.0 00000100:00100000:3.0:1789264140.312922:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322730752 00000100:00100000:3.0:1789264140.312927:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322730752 00000100:00100000:3.0:1789264140.312965:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789264140.312973:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322730752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264140.313022:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322730752:12345-0@lo:400:kworker.0 Request processed in 51us (2590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264140.313035:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789264140.313117:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abad81180 x1876179322730752/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264140.313128:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322730752:0@lo:400:kworker.0 00000100:00100000:2.0:1789264140.313288:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789264140.313297:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322730240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264140.313345:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322730240:12345-0@lo:400:kworker.0 Request processed in 50us (2968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264140.313351:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1789264140.313596:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac60e00 x1876179322730240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264140.313604:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322730240:0@lo:400:kworker.0 00000100:00100000:3.0:1789264140.812474:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789264140.812531:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322730880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789264140.812620:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264140.812694:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322730880 00000100:00100000:3.0:1789264140.812701:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322730880 00000100:00100000:3.0:1789264140.812784:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789264140.812795:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322730880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789264140.812827:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789264140.812875:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322730880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264140.812883:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789264140.812931:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322730880:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789264140.937864:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264141.961981:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264142.797579:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264142.797614:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264142.797631:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311140096 00000100:00100000:3.0:1789264142.797636:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264142.797640:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311140096 00000100:00100000:3.0:1789264142.797652:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264142.797674:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264142.797694:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311140352 00000100:00100000:3.0:1789264142.797698:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311140352 00000100:00100000:3.0:1789264142.797763:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311140224 00000100:00100000:1.0:1789264142.797764:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 269 00000100:00100000:3.0:1789264142.797767:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311140224 00000100:00100000:1.0:1789264142.797774:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2404:x1876179311140096:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264142.797788:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:3.0:1789264142.797795:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311140352:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264142.797838:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2404:x1876179311140096:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 66us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264142.797846:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 269 00000100:00080000:1.0:1789264142.798005:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789264142.798009:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789264142.798023:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:1.0:1789264142.798031:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2404:x1876179311140224:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264142.799816:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311140608 00000100:00100000:2.0:1789264142.799828:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311140608 00000100:00100000:2.0:1789264142.799883:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311140480 00000100:00100000:2.0:1789264142.799887:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311140480 00000100:00100000:2.0:1789264142.799909:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:2.0:1789264142.799922:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311140608:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264142.800563:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311140352:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 2765us (2945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264142.800563:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2404:x1876179311140224:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 2530us (2905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264142.800574:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:3.0:1789264142.800580:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:3.0:1789264142.800604:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:3.0:1789264142.800612:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311140480:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264142.800649:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311140480:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 39us (2974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264142.800655:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00080000:1.0:1789264142.800918:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789264142.800989:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789264142.801093:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311140608:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 1164us (3442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264142.801100:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:0.0:1789264142.858865:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322731008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789264142.859327:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789264142.859427:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322731136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789264142.859466:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264142.859541:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322731136 00000100:00100000:1.0:1789264142.859548:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322731136 00000100:00100000:1.0:1789264142.859629:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789264142.859638:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322731136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789264142.859682:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264142.859728:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322731136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264142.859734:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789264142.859777:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789264142.859809:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398364fb80 x1876179322731136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264142.859827:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322731136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789264142.860442:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264142.861045:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322731008 00000100:00100000:1.0:1789264142.861052:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322731008 00000100:00080000:0.0:1789264142.861159:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264142.862845:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789264142.862865:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322731008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789264142.862891:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264142.862967:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322731008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264142.862975:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789264142.863686:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39837f0000 x1876179322731008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264142.863708:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322731008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789264142.985969:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789264143.313296:0:10905:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing yml_node 00000100:00100000:3.0:1789264143.371097:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789264143.371120:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322731264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789264143.371184:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264143.371236:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322731264 00000100:00100000:3.0:1789264143.371243:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322731264 00000100:00100000:3.0:1789264143.371291:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789264143.371301:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322731264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789264143.371328:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789264143.371371:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322731264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264143.371378:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789264143.371420:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322731264:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789264144.012509:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264145.033863:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264145.418412:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322731392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264145.418482:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264145.418555:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322731904:0@lo:400:kworker.0 00000100:00100000:2.0:1789264145.418590:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264145.418615:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322732416:0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.418634:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322731648:0@lo:400:kworker.0 00000100:00100000:2.0:1789264145.418642:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264145.418665:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322732928:0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.418675:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264145.418692:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264145.418706:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322732160:0@lo:400:kworker.0 00000100:00100000:2.0:1789264145.418715:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789264145.418723:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322731520:0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.418773:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264145.418778:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264145.418800:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322732672:0@lo:400:kworker.0 00000100:00100000:2.0:1789264145.418808:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322732032:0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.418861:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264145.418862:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264145.418893:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322732544:0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.418894:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789264145.418906:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322731776:0@lo:400:kworker.0 00000100:00100000:2.0:1789264145.418922:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264145.418939:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264145.418967:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322732288:0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.418988:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264145.418990:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322731904 00000100:00100000:2.0:1789264145.418997:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322731904 00000100:00100000:3.0:1789264145.419005:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322732800:0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.419033:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264145.419043:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322731648 00000100:00100000:2.0:1789264145.419048:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322731648 00000100:00100000:2.0:1789264145.419074:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322732160 00000100:00100000:2.0:1789264145.419078:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322732160 00000100:00100000:2.0:1789264145.419098:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322732672 00000100:00100000:2.0:1789264145.419101:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322732672 00000100:00100000:2.0:1789264145.419121:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322732288 00000100:00100000:2.0:1789264145.419124:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322732288 00000100:00100000:2.0:1789264145.419135:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322732800 00000100:00100000:2.0:1789264145.419138:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322732800 00000100:00100000:2.0:1789264145.419157:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789264145.419166:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322731904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.419233:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789264145.419246:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322731648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.419289:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322731648:12345-0@lo:400:kworker.0 Request processed in 48us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264145.419296:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789264145.419386:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322731904:12345-0@lo:400:kworker.0 Request processed in 220us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264145.419963:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322732160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264145.420007:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322732160:12345-0@lo:400:kworker.0 Request processed in 702us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264145.420564:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322731392 00000100:00100000:0.0:1789264145.420573:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322731392 00000100:00100000:0.0:1789264145.420633:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789264145.420643:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322731392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789264145.420666:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264145.420710:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322731392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264145.420717:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789264145.421132:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322731520 00000100:00100000:0.0:1789264145.421137:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322731520 00000100:00100000:0.0:1789264145.421167:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789264145.421175:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322731520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.421250:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789264145.421274:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789264145.421287:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322732672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.421327:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322732672:12345-0@lo:400:kworker.0 Request processed in 47us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264145.421334:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789264145.421345:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789264145.421354:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322732288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264145.421477:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789264145.421491:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322731520:12345-0@lo:400:kworker.0 Request processed in 37us (2434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264145.421500:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789264145.421503:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789264145.421520:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322732800:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789264145.421542:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789264145.421549:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789264145.421553:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789264145.421568:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322732416 00000100:00100000:0.0:1789264145.421573:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322732416 00000100:00100000:3.0:1789264145.421577:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322732288:12345-0@lo:400:kworker.0 Request processed in 223us (2586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264145.421578:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322732800:12345-0@lo:400:kworker.0 Request processed in 68us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264145.421593:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789264145.421610:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322732928 00000100:00100000:0.0:1789264145.421615:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322732928 00000100:00100000:3.0:1789264145.421623:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322732032 00000100:00100000:3.0:1789264145.421629:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322732032 00000100:00100000:1.0:1789264145.421636:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789264145.421642:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322732544 00000100:00100000:0.0:1789264145.421655:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322732544 00000100:00100000:0.0:1789264145.421685:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789264145.421694:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322732416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264145.421717:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322733056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789264145.421768:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322731776 00000100:00100000:3.0:1789264145.421773:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322731776 00000100:00100000:3.0:1789264145.421793:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789264145.421799:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322732032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264145.422729:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789264145.422778:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789264145.422792:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322732928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264145.423600:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264145.423612:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322732032:12345-0@lo:400:kworker.0 Request processed in 1810us (4751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264145.423622:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789264145.423647:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789264145.423659:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322731776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264145.423665:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322733056 00000100:00100000:1.0:1789264145.423673:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322733056 00000100:00100000:1.0:1789264145.423705:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789264145.423712:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1876179322733056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789264145.423729:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264145.423790:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1876179322733056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264145.423799:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789264145.423807:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322731776:12345-0@lo:400:kworker.0 Request processed in 151us (4866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264145.423814:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1789264145.423842:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398364fb80 x1876179322733056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264145.423861:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322733056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264145.423912:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789264145.423921:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1789264145.423932:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322731776:0@lo:400:kworker.0 00000100:00080000:1.0:1789264145.423937:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789264145.423944:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789264145.423950:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983cd2300 x1876179322732288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264145.423960:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322732288:0@lo:400:kworker.0 00010000:00080000:3.0:1789264145.423972:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983cd3100 x1876179322732800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264145.423981:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322732800:0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.423997:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322731648:0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.424010:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322732160:0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.424023:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322732672:0@lo:400:kworker.0 00000100:00100000:1.0:1789264145.424047:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789264145.424057:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322732544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.424092:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322731520:0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.424118:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322732032:0@lo:400:kworker.0 00000100:00100000:3.0:1789264145.424131:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322731904:0@lo:400:kworker.0 00010000:00080000:3.0:1789264145.424143:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39837f0000 x1876179322731392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264145.424156:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322731392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789264145.424437:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322732544:12345-0@lo:400:kworker.0 Request processed in 381us (5514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264145.424444:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789264145.424596:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983cd1880 x1876179322732544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264145.424607:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322732544:0@lo:400:kworker.0 00000100:00100000:2.0:1789264145.425609:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322732928:12345-0@lo:400:kworker.0 Request processed in 2821us (6913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264145.425620:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789264145.425694:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322732416:12345-0@lo:400:kworker.0 Request processed in 4000us (7050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264145.425701:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789264145.427423:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983cd3800 x1876179322732928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264145.427441:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322732928:0@lo:400:kworker.0 00010000:00080000:3.0:1789264145.427456:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983cd3480 x1876179322732416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264145.427463:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322732416:0@lo:400:kworker.0 00000100:00100000:0.0:1789264145.930018:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322733184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789264145.930100:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264145.930450:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322733184 00000100:00100000:3.0:1789264145.930459:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322733184 00000100:00100000:3.0:1789264145.930527:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789264145.930538:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322733184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789264145.930569:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789264145.930667:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322733184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264145.930674:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789264145.932480:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322733184:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789264146.057996:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789264146.533099:0:11090:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.104 00010000:00010000:2.0:1789264147.083163:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264147.917193:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264147.917297:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264147.917340:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264147.917369:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264147.917398:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264147.917422:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311140992 00000100:00100000:3.0:1789264147.917431:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311140992 00000100:00100000:2.0:1789264147.917452:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311141248 00000100:00100000:2.0:1789264147.917458:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311141248 00000100:00100000:3.0:1789264147.917501:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311140864 00000100:00100000:3.0:1789264147.917505:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311140864 00000100:00100000:2.0:1789264147.917507:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311141120 00000100:00100000:2.0:1789264147.917512:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311141120 00000100:00100000:3.0:1789264147.917541:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:2.0:1789264147.917549:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:3.0:1789264147.917555:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311140992:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264147.917564:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311141248:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264147.917640:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311140992:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 80us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264147.917655:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:0.0:1789264147.917667:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2405:x1876179311140864:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264147.917939:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311140736 00000100:00100000:1.0:1789264147.917945:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311140736 00000100:00100000:1.0:1789264147.917977:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 271 00000100:00100000:1.0:1789264147.917984:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2405:x1876179311140736:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264147.918033:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:3.0:1789264147.918067:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:3.0:1789264147.918075:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311141120:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264147.918500:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311141248:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 941us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264147.918504:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2405:x1876179311140864:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 836us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264147.918524:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:1.0:1789264147.918526:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2405:x1876179311140736:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 530us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264147.918526:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:1.0:1789264147.918549:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 271 00000100:00080000:2.0:1789264147.918581:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789264147.918587:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789264147.918591:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789264147.918593:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789264147.919521:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311141120:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 1432us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264147.919533:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:3.0:1789264147.980459:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322733312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789264147.980527:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264147.980599:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322733312 00000100:00100000:3.0:1789264147.980606:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322733312 00000100:00100000:3.0:1789264147.980665:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789264147.980674:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322733312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789264147.980700:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264147.980768:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322733312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264147.980776:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789264147.980806:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789264147.980855:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983cd2d80 x1876179322733312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264147.980873:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322733312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789264147.982460:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789264147.982479:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322733440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789264147.982529:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264147.982599:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322733440 00000100:00100000:2.0:1789264147.982605:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322733440 00000100:00100000:2.0:1789264147.982665:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789264147.982674:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322733440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789264147.982692:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264147.982733:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322733440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264147.982763:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789264147.982801:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836e0e00 x1876179322733440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264147.982837:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322733440:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789264147.983051:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789264148.108386:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789264148.219519:0:11187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.104 00000100:00100000:0.0:1789264148.489977:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789264148.493186:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322733568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789264148.493260:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264148.493412:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322733568 00000100:00100000:3.0:1789264148.493422:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322733568 00000100:00100000:3.0:1789264148.493498:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789264148.493509:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322733568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789264148.493543:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789264148.493597:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322733568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264148.493604:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789264148.493629:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322733568:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789264149.130444:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789264149.977625:0:11284:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.104 00010000:00010000:2.0:1789264150.154529:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264150.537944:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322733952:0@lo:400:kworker.0 00000100:00100000:3.0:1789264150.538036:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322734080:0@lo:400:kworker.0 00000100:00100000:1.0:1789264150.538069:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264150.538097:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264150.538136:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322734592:0@lo:400:kworker.0 00000100:00100000:1.0:1789264150.538145:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322734464:0@lo:400:kworker.0 00000100:00100000:3.0:1789264150.538161:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264150.538180:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264150.538181:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1876179322735104:0@lo:400:kworker.0 00000100:00100000:3.0:1789264150.538208:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264150.538215:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1876179322734976:0@lo:400:kworker.0 00000100:00100000:3.0:1789264150.538247:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322733952 00000100:00100000:3.0:1789264150.538255:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322733952 00000100:00100000:3.0:1789264150.538297:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322734592 00000100:00100000:3.0:1789264150.538300:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322734592 00000100:00100000:3.0:1789264150.538321:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322734464 00000100:00100000:3.0:1789264150.538324:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322734464 00000100:00100000:3.0:1789264150.538334:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322735104 00000100:00100000:3.0:1789264150.538343:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322735104 00000100:00100000:3.0:1789264150.538373:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789264150.538381:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322733952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264150.538423:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322733952:12345-0@lo:400:kworker.0 Request processed in 44us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264150.538430:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789264150.538444:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789264150.538450:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322734592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264150.538475:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322734592:12345-0@lo:400:kworker.0 Request processed in 25us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264150.538480:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789264150.538489:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789264150.538496:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876179322734464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264150.538518:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876179322734464:12345-0@lo:400:kworker.0 Request processed in 24us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264150.538524:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789264150.538677:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322733696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264150.538708:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264150.538720:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789264150.538734:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876179322735104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264150.538738:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322734208:0@lo:400:kworker.0 00000100:00100000:3.0:1789264150.538797:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876179322735104:12345-0@lo:400:kworker.0 Request processed in 68us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264150.538805:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789264150.538807:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322733824:0@lo:400:kworker.0 00000100:00100000:3.0:1789264150.538826:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322734080 00000100:00100000:3.0:1789264150.538832:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322734080 00000100:00100000:2.0:1789264150.538841:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264150.538868:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322734336:0@lo:400:kworker.0 00000100:00100000:3.0:1789264150.538880:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789264150.538889:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322734080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264150.538897:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264150.538912:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322734848:0@lo:400:kworker.0 00000100:00100000:3.0:1789264150.538942:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322734080:12345-0@lo:400:kworker.0 Request processed in 54us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264150.538947:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264150.538959:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789264150.538970:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322735360:0@lo:400:kworker.0 00000100:00100000:3.0:1789264150.538973:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322734336 00000100:00100000:3.0:1789264150.538978:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322734336 00000100:00100000:2.0:1789264150.538997:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264150.539003:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789264150.539013:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322734336:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789264150.539281:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789264150.539286:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789264150.539310:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322734848 00000100:00100000:0.0:1789264150.539314:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322734848 00000100:00100000:0.0:1789264150.539347:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322735360 00000100:00100000:0.0:1789264150.539351:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322735360 00000100:00100000:0.0:1789264150.539371:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789264150.539380:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322734848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264150.539525:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264150.541191:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322733696 00000100:00100000:2.0:1789264150.541203:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322733696 00000100:00100000:2.0:1789264150.541384:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789264150.541396:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322733696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789264150.541431:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264150.542302:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322734336:12345-0@lo:400:kworker.0 Request processed in 3288us (3403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264150.542312:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789264150.542477:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322733696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1084us (3767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264150.542485:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789264150.542515:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789264150.542537:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322735360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264150.542570:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322735360:12345-0@lo:400:kworker.0 Request processed in 37us (3575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264150.542575:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789264150.542599:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264150.542628:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322734720:0@lo:400:kworker.0 00000100:00100000:2.0:1789264150.542655:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264150.542671:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322735232:0@lo:400:kworker.0 00000100:00100000:2.0:1789264150.542687:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789264150.542719:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398364d180 x1876179322733696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264150.542737:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322733696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264150.542773:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322734720 00000100:00100000:2.0:1789264150.542777:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322734720 00000100:00100000:2.0:1789264150.542798:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322735232 00000100:00100000:2.0:1789264150.542799:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322735232 00000100:00100000:2.0:1789264150.542813:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789264150.542818:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322734720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264150.542847:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322734720:12345-0@lo:400:kworker.0 Request processed in 29us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264150.542853:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789264150.542863:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789264150.542869:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322735232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264150.542889:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322735232:12345-0@lo:400:kworker.0 Request processed in 22us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264150.542895:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789264150.542915:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322734976 00000100:00100000:2.0:1789264150.542919:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322734976 00000100:00100000:2.0:1789264150.542940:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322734208 00000100:00100000:2.0:1789264150.542942:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322734208 00000100:00100000:2.0:1789264150.542957:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789264150.542962:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1876179322734976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264150.542990:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1876179322734976:12345-0@lo:400:kworker.0 Request processed in 29us (4746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264150.542996:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789264150.543152:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322734848:12345-0@lo:400:kworker.0 Request processed in 3773us (4204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264150.543165:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789264150.543208:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789264150.543217:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322734208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264150.543252:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322734208:12345-0@lo:400:kworker.0 Request processed in 38us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264150.543339:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322734080:0@lo:400:kworker.0 00010000:00080000:3.0:1789264150.543353:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983cd3480 x1876179322734592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264150.543362:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322734592:0@lo:400:kworker.0 00010000:00080000:3.0:1789264150.543372:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ababbc700 x1876179322735104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264150.543381:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1876179322735104:0@lo:400:kworker.0 00000100:00100000:3.0:1789264150.543400:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789264150.543423:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1876179322734976:0@lo:400:kworker.0 00000100:00100000:1.0:1789264150.543436:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322733952:0@lo:400:kworker.0 00000100:00100000:1.0:1789264150.543454:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322734464:0@lo:400:kworker.0 00000100:00100000:1.0:1789264150.543469:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322733824 00000100:00100000:1.0:1789264150.543472:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322733824 00000100:00100000:1.0:1789264150.543498:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789264150.543503:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3623:x1876179322733824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264150.543530:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3623:x1876179322733824:12345-0@lo:400:kworker.0 Request processed in 27us (4691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264150.543535:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:1.0:1789264150.543571:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789264150.543575:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789264150.543582:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264150.543608:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322733824:0@lo:400:kworker.0 00000100:00100000:1.0:1789264150.543619:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322734336:0@lo:400:kworker.0 00010000:00080000:1.0:1789264150.543630:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ababbfb80 x1876179322734848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264150.543640:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322734848:0@lo:400:kworker.0 00010000:00080000:1.0:1789264150.543649:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983d5ce00 x1876179322735360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264150.543656:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322735360:0@lo:400:kworker.0 00000100:00100000:1.0:1789264150.543685:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322734208:0@lo:400:kworker.0 00010000:00080000:1.0:1789264150.543693:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ababbc380 x1876179322734720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264150.543701:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322734720:0@lo:400:kworker.0 00010000:00080000:1.0:1789264150.543709:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983d5d180 x1876179322735232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264150.543716:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322735232:0@lo:400:kworker.0 00000100:00100000:3.0:1789264150.543889:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322735488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264150.543919:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264150.543975:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322735488 00000100:00100000:0.0:1789264150.543980:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322735488 00000100:00100000:0.0:1789264150.544008:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789264150.544014:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322735488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789264150.544037:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264150.544079:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322735488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264150.544085:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789264150.544143:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39837f0e00 x1876179322735488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264150.544156:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322735488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264150.544223:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789264151.051067:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789264151.051090:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322735616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789264151.051156:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264151.051262:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322735616 00000100:00100000:1.0:1789264151.051270:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322735616 00000100:00100000:1.0:1789264151.051337:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789264151.051356:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322735616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789264151.051390:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789264151.051516:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322735616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 163us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264151.051524:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789264151.052227:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322735616:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1789264151.103302:0:11332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 12 21:49:10 EDT 2026 00010000:00010000:3.0:1789264151.181050:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264152.204208:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264153.038623:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264153.038671:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264153.038701:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311141504 00000100:00100000:3.0:1789264153.038710:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311141504 00000100:00100000:1.0:1789264153.038725:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311141376 00000100:00100000:1.0:1789264153.038732:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311141376 00000100:00100000:3.0:1789264153.038797:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:1.0:1789264153.038807:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 273 00000100:00100000:3.0:1789264153.038813:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311141504:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264153.038821:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2402:x1876179311141376:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264153.038894:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311141504:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 86us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264153.038895:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2402:x1876179311141376:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 75us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264153.038913:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:1.0:1789264153.038914:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 273 00000100:00080000:1.0:1789264153.038951:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789264153.041983:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264153.042269:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311141632 00000100:00100000:1.0:1789264153.042279:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311141632 00000100:00100000:1.0:1789264153.042358:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 71 00000100:00100000:1.0:1789264153.042370:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311141632:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264153.042443:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311141632:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 76us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264153.042452:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 71 00000100:00080000:0.0:1789264153.042669:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789264153.048495:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264153.048593:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264153.048673:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311141760 00000100:00100000:0.0:1789264153.048682:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311141760 00000100:00100000:0.0:1789264153.048774:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311141888 00000100:00100000:0.0:1789264153.048782:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311141888 00000100:00100000:0.0:1789264153.048812:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:0.0:1789264153.048822:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2401:x1876179311141760:12345-192.168.203.44@tcp:9:kworker.0 00000100:00100000:2.0:1789264153.048826:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:2.0:1789264153.048842:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2401:x1876179311141888:12345-192.168.203.44@tcp:9:kworker.0 00000020:00000080:0.0:1789264153.048860:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6bca 00000020:00000080:2.0:1789264153.048867:0:8406:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6bd1 00000100:00080000:0.0:1789264153.048873:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9c3abf637000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789264153.048878:0:8406:0:(import.c:65:import_set_state_nolock()) ffff9c3abf637800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789264153.048917:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789264153.049078:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+2:2401:x1876179311141760:12345-192.168.203.44@tcp:9:kworker.0 Request processed in 257us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264153.049096:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00080000:1.0:1789264153.049194:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789264153.049197:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789264153.049879:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789264153.049890:0:8406:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789264153.050833:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+2:2401:x1876179311141888:12345-192.168.203.44@tcp:9:kworker.0 Request processed in 1990us (2234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264153.050846:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 19 00010000:00010000:0.0:1789264153.053279:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264153.097923:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322735744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789264153.098062:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264153.098155:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322735744 00000100:00100000:0.0:1789264153.098164:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322735744 00000100:00100000:0.0:1789264153.098229:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789264153.098238:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322735744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789264153.098265:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264153.101468:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322735744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3222us (3397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264153.101600:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789264153.101696:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789264153.102429:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322735872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789264153.102493:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264153.102726:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322735872 00000100:00100000:3.0:1789264153.102734:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322735872 00000100:00100000:3.0:1789264153.102815:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789264153.102827:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322735872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789264153.102856:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264153.102906:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322735872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264153.102913:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789264153.102948:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983725180 x1876179322735872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264153.102967:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322735872:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789264153.103332:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836e3480 x1876179322735744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264153.103350:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322735744:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789264153.103566:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789264153.227116:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264153.612291:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789264153.612310:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322736000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789264153.612365:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264153.612480:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322736000 00000100:00100000:2.0:1789264153.612486:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322736000 00000100:00100000:2.0:1789264153.612547:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789264153.612555:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322736000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789264153.612582:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789264153.612621:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322736000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264153.612625:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789264153.612817:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322736000:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789264154.250644:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264155.280513:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264155.658136:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322736128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789264155.658205:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264155.658278:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322736128 00000100:00100000:0.0:1789264155.658285:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322736128 00000100:00100000:0.0:1789264155.658334:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789264155.658344:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322736128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789264155.658371:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264155.658416:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322736128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264155.658423:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789264155.658444:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789264155.658475:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39837f0e00 x1876179322736128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264155.658522:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322736128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264155.659915:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322736256:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.659966:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264155.660008:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322736768:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.660033:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264155.660443:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322736256 00000100:00100000:1.0:1789264155.660450:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322736256 00000100:00100000:1.0:1789264155.660494:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789264155.660502:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322736256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264155.660548:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322736256:12345-0@lo:400:kworker.0 Request processed in 47us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264155.660556:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789264155.660623:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322737280:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.660656:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264155.660691:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322737792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264155.660714:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264155.660774:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322736256:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.660792:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789264155.660798:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322736384:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.660823:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264155.660842:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322736896:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.660860:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264155.660875:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322737408:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.660893:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264155.660917:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322736768 00000100:00100000:2.0:1789264155.660935:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322736768 00000100:00100000:2.0:1789264155.660977:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789264155.661005:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322736768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.661046:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322736768:12345-0@lo:400:kworker.0 Request processed in 53us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264155.661053:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789264155.661112:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322736384 00000100:00100000:2.0:1789264155.661116:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322736384 00000100:00100000:2.0:1789264155.661139:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322736896 00000100:00100000:2.0:1789264155.661142:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322736896 00000100:00100000:2.0:1789264155.661166:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322737408 00000100:00100000:2.0:1789264155.661168:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322737408 00000100:00100000:2.0:1789264155.661190:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789264155.661196:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322736384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.661226:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322736384:12345-0@lo:400:kworker.0 Request processed in 30us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264155.661232:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789264155.661244:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789264155.661251:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322736896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.661277:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322736896:12345-0@lo:400:kworker.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264155.661283:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789264155.661294:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789264155.661301:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322737408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.661324:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322737408:12345-0@lo:400:kworker.0 Request processed in 25us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264155.661330:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789264155.661425:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322736512:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.661462:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264155.661481:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322737024:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.661500:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264155.661631:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322737792 00000100:00100000:3.0:1789264155.661635:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322737792 00000100:00100000:3.0:1789264155.661674:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789264155.661682:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322737792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789264155.661696:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264155.661731:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322737792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264155.661763:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789264155.661838:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322737280 00000100:00100000:1.0:1789264155.661842:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322737280 00000100:00100000:1.0:1789264155.661890:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789264155.661898:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaf84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322737280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264155.661932:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaf84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322737280:12345-0@lo:400:kworker.0 Request processed in 36us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264155.661938:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789264155.662186:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322737536:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.662230:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264155.663048:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322736640:0@lo:400:kworker.0 00000100:00100000:1.0:1789264155.665600:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322737024 00000100:00100000:0.0:1789264155.665600:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322737536 00000100:00100000:1.0:1789264155.665612:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322737024 00000100:00100000:0.0:1789264155.665613:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322737536 00000100:00100000:1.0:1789264155.665675:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789264155.665688:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789264155.665698:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322737536:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789264155.665825:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789264155.665831:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789264155.665835:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789264155.665838:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264155.665853:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322736512 00000100:00100000:0.0:1789264155.665856:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322737536:12345-0@lo:400:kworker.0 Request processed in 158us (3623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264155.665859:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322736512 00000100:00100000:0.0:1789264155.665867:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789264155.665909:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789264155.665918:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322736512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.665957:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322736512:12345-0@lo:400:kworker.0 Request processed in 42us (4495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264155.665964:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789264155.666021:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322736384:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.666034:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322736896:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.666109:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322737408:0@lo:400:kworker.0 00010000:00080000:2.0:1789264155.666128:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abad81180 x1876179322737792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264155.666147:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322737792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264155.666160:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322736768:0@lo:400:kworker.0 00010000:00080000:2.0:1789264155.666172:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983725880 x1876179322737280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264155.666195:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322737280:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.666240:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322736512:0@lo:400:kworker.0 00010000:00080000:2.0:1789264155.666251:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983727100 x1876179322737536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264155.666259:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322737536:0@lo:400:kworker.0 00000100:00100000:1.0:1789264155.666358:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322737024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264155.666407:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322737024:12345-0@lo:400:kworker.0 Request processed in 724us (4905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264155.666414:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1789264155.666641:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983726300 x1876179322737024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264155.666651:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322737024:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.667196:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264155.667317:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322737152:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.667352:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264155.667377:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322737664:0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.667394:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264155.667423:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322737152 00000100:00100000:2.0:1789264155.667427:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322737152 00000100:00100000:2.0:1789264155.667463:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322737664 00000100:00100000:2.0:1789264155.667465:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322737664 00000100:00100000:2.0:1789264155.667483:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789264155.667490:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322737152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.667539:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322737152:12345-0@lo:400:kworker.0 Request processed in 49us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264155.667546:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789264155.667558:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789264155.667573:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322737664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264155.667603:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322737664:12345-0@lo:400:kworker.0 Request processed in 32us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264155.667609:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789264155.667629:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789264155.667649:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983727480 x1876179322737152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264155.667658:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322737152:0@lo:400:kworker.0 00010000:00080000:2.0:1789264155.667667:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983727800 x1876179322737664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264155.667675:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322737664:0@lo:400:kworker.0 00000100:00100000:1.0:1789264155.667862:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322736640 00000100:00100000:1.0:1789264155.667866:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322736640 00000100:00100000:1.0:1789264155.667938:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789264155.667946:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322736640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264155.668004:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322736640:12345-0@lo:400:kworker.0 Request processed in 59us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264155.668010:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789264155.671108:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322736640:0@lo:400:kworker.0 00000100:00100000:3.0:1789264156.169977:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322737920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789264156.170059:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264156.170218:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322737920 00000100:00100000:2.0:1789264156.170225:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322737920 00000100:00100000:2.0:1789264156.170287:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789264156.170297:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322737920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789264156.170330:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789264156.170386:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322737920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264156.170393:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789264156.170434:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322737920:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789264156.298096:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264157.326023:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264158.158091:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264158.158159:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311142144 00000100:00100000:0.0:1789264158.158168:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311142144 00000100:00100000:0.0:1789264158.158233:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 78 00000100:00100000:0.0:1789264158.158242:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311142144:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264158.158312:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311142144:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 71us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264158.158325:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 78 00000100:00100000:3.0:1789264158.158326:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00080000:0.0:1789264158.158354:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789264158.158416:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311142016 00000100:00100000:0.0:1789264158.158421:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311142016 00000100:00100000:0.0:1789264158.158453:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 275 00000100:00100000:0.0:1789264158.158461:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2402:x1876179311142016:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264158.158503:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2402:x1876179311142016:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 43us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264158.158509:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 275 00000100:00100000:0.0:1789264158.158560:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264158.158595:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311142272 00000100:00100000:0.0:1789264158.158599:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311142272 00000100:00100000:0.0:1789264158.158625:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 79 00000100:00100000:0.0:1789264158.158631:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311142272:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264158.158660:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311142272:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 29us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264158.158667:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 79 00000100:00080000:0.0:1789264158.158681:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789264158.217909:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322738048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789264158.217987:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264158.218093:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322738048 00000100:00100000:3.0:1789264158.218100:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322738048 00000100:00100000:3.0:1789264158.218161:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789264158.218177:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322738048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789264158.218213:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264158.218260:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322738048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264158.218269:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789264158.218495:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322738176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789264158.218529:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789264158.218914:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264158.218927:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322738176 00000100:00100000:0.0:1789264158.218931:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322738176 00000100:00100000:0.0:1789264158.218967:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789264158.218985:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322738176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789264158.219000:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264158.219037:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322738176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264158.219043:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789264158.219088:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983d5ca80 x1876179322738048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264158.219105:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322738048:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789264158.219159:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789264158.219179:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983d5f100 x1876179322738176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264158.219204:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322738176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789264158.346363:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789264158.731609:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 92638a4f-1391-4305-a4ab-5961bcacc46a 00000020:00000080:3.0:1789264158.731618:0:8398:0:(genops.c:885:class_export_put()) final put ffff9c3abf630800/92638a4f-1391-4305-a4ab-5961bcacc46a 00000100:00100000:2.0:1789264158.731790:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322738304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789264158.731859:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264158.731993:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322738304 00000100:00100000:2.0:1789264158.732000:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322738304 00000100:00100000:2.0:1789264158.732059:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789264158.732068:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322738304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789264158.732097:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789264158.732141:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322738304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264158.732147:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000020:00000080:0.0:1789264158.732753:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3abf630800/92638a4f-1391-4305-a4ab-5961bcacc46a for lustre-OST0000 00000020:00000080:0.0:1789264158.732814:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3abf637000 for lustre-OST0000 00000001:00100000:3.0:1789264158.733271:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 92638a4f-1391-4305-a4ab-5961bcacc46a 00000020:00000080:3.0:1789264158.733275:0:9482:0:(genops.c:885:class_export_put()) final put ffff9c3abf630000/92638a4f-1391-4305-a4ab-5961bcacc46a 00000100:00100000:2.0:1789264158.733350:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322738304:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1789264158.733938:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3abf630000/92638a4f-1391-4305-a4ab-5961bcacc46a for lustre-OST0001 00000020:00000080:0.0:1789264158.734002:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3abf637800 for lustre-OST0001 00010000:00010000:2.0:1789264159.370050:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264160.395038:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264160.778145:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322738432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264160.778215:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264160.778324:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322738432 00000100:00100000:3.0:1789264160.778332:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322738432 00000100:00100000:0.0:1789264160.778394:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322738560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264160.778412:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789264160.778429:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789264160.778431:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789264160.778433:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322738432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789264160.778464:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264160.778547:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322738688:0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.778581:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264160.778623:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322738688 00000100:00100000:0.0:1789264160.778628:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322738688 00000100:00100000:0.0:1789264160.778658:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789264160.778664:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3625:x1876179322738688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.778701:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3625:x1876179322738688:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264160.778708:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789264160.778772:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322738688:0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.779154:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322738816:0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.779187:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264160.779249:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322738816 00000100:00100000:0.0:1789264160.779254:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322738816 00000100:00100000:0.0:1789264160.779282:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789264160.779289:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322738816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.779345:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322738816:12345-0@lo:400:kworker.0 Request processed in 56us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264160.779353:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789264160.779385:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322738816:0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.780435:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789264160.780454:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322739328:0@lo:400:kworker.0 00000100:00100000:2.0:1789264160.780481:0:8407:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789264160.780492:0:8407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1789264160.780512:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322739072:0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.780521:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264160.780552:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322738944:0@lo:400:kworker.0 00000100:00100000:1.0:1789264160.780560:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264160.780589:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322739584:0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.780593:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264160.780626:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322739840:0@lo:400:kworker.0 00000100:00100000:1.0:1789264160.780631:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264160.780662:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264160.780663:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789264160.780672:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322739200:0@lo:400:kworker.0 00000100:00100000:2.0:1789264160.780681:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322738560 00000100:00100000:2.0:1789264160.780688:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322738560 00000100:00100000:1.0:1789264160.780712:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264160.780737:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322739712:0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.780780:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789264160.780788:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322739456:0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.780813:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264160.780831:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322739968:0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.780860:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264160.780876:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322738432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2452us (2657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264160.780885:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322739328 00000100:00100000:0.0:1789264160.780889:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322739328 00000100:00100000:0.0:1789264160.780908:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322739072 00000100:00100000:0.0:1789264160.780910:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322739072 00000100:00100000:0.0:1789264160.780918:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322739840 00000100:00100000:0.0:1789264160.780920:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322739840 00000100:00100000:0.0:1789264160.780928:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322739456 00000100:00100000:0.0:1789264160.780929:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322739456 00000100:00100000:0.0:1789264160.780936:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322739968 00000100:00100000:0.0:1789264160.780938:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322739968 00000100:00100000:0.0:1789264160.780948:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789264160.780952:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322739328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264160.780979:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789264160.781002:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322739328:12345-0@lo:400:kworker.0 Request processed in 48us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264160.781005:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789264160.781013:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789264160.781024:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789264160.781028:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322739072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.781053:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322739072:12345-0@lo:400:kworker.0 Request processed in 26us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264160.781057:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789264160.781064:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789264160.781068:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322739840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.781080:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322739840:12345-0@lo:400:kworker.0 Request processed in 13us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264160.781084:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789264160.781090:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789264160.781099:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322738560:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789264160.781099:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322739456:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789264160.781122:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264160.781130:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322739456:12345-0@lo:400:kworker.0 Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264160.781137:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789264160.781150:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789264160.781157:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322739968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264160.781164:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322738560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (2735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264160.781172:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789264160.781191:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322739968:12345-0@lo:400:kworker.0 Request processed in 35us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264160.781197:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789264160.781218:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322738944 00000100:00100000:0.0:1789264160.781222:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322738944 00000100:00100000:0.0:1789264160.781260:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322739200 00000100:00100000:0.0:1789264160.781263:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322739200 00000100:00100000:0.0:1789264160.781278:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789264160.781284:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322738944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.781316:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322738944:12345-0@lo:400:kworker.0 Request processed in 32us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264160.781331:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789264160.781344:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789264160.781348:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322739200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.781378:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322739200:12345-0@lo:400:kworker.0 Request processed in 30us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264160.781383:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1789264160.781417:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398374ea00 x1876179322739456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264160.781428:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322739456:0@lo:400:kworker.0 00010000:00080000:0.0:1789264160.781438:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398374f100 x1876179322739968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264160.781445:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322739968:0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.781453:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322739840:0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.781461:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322739328:0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.781468:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322738944:0@lo:400:kworker.0 00010000:00080000:0.0:1789264160.781521:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ab301df80 x1876179322738432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264160.781534:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322738432:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789264160.781556:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789264160.781560:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789264160.781562:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789264160.781584:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322739584 00000100:00100000:0.0:1789264160.781593:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322739584 00000100:00100000:0.0:1789264160.781627:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789264160.781633:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322739584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264160.781665:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322739584:12345-0@lo:400:kworker.0 Request processed in 33us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264160.781671:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789264160.782289:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264160.782327:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322739072:0@lo:400:kworker.0 00010000:00080000:1.0:1789264160.782341:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398374df80 x1876179322739584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264160.782350:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322739584:0@lo:400:kworker.0 00010000:00080000:1.0:1789264160.782361:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39837f3100 x1876179322738560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264160.782374:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322738560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789264160.782400:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322739200:0@lo:400:kworker.0 00000100:00100000:1.0:1789264160.782421:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322739712 00000100:00100000:1.0:1789264160.782425:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322739712 00000100:00100000:1.0:1789264160.782459:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789264160.782466:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322739712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264160.782505:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322739712:12345-0@lo:400:kworker.0 Request processed in 39us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264160.782512:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789264160.782540:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398374dc00 x1876179322739712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264160.782550:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322739712:0@lo:400:kworker.0 00000100:00080000:1.0:1789264160.783010:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264161.290343:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322740096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789264161.290417:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264161.290525:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322740096 00000100:00100000:3.0:1789264161.290533:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322740096 00000100:00100000:3.0:1789264161.290597:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789264161.290606:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322740096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789264161.290639:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789264161.294081:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322740096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3468us (3655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264161.294095:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789264161.294115:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322740096:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1789264161.345271:0:11962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:49:20 (1789264160) === 00010000:00010000:2.0:1789264161.419017:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264161.735145:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264161.735263:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311142400 00000100:00100000:1.0:1789264161.735273:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311142400 00000100:00100000:1.0:1789264161.735339:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 277 00000100:00100000:1.0:1789264161.735349:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:8709:x1876179311142400:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789264161.735364:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264161.735385:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6cbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bda9b1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264161.735413:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6cbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9b1 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264161.735426:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6cbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9b1 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264161.735435:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f094200, rc 0) 00000100:00100000:1.0:1789264161.735497:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:8709:x1876179311142400:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 150us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264161.735504:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 277 00000100:00100000:3.0:1789264161.743082:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264161.743363:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311142528 00000100:00100000:0.0:1789264161.743374:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311142528 00000100:00100000:0.0:1789264161.743487:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 278 00000100:00100000:0.0:1789264161.743499:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:8709:x1876179311142528:12345-192.168.203.44@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789264161.743659:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:8709:x1876179311142528:12345-192.168.203.44@tcp:501:mount.lustre.0 Request processed in 163us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264161.743667:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 278 00000100:00100000:0.0:1789264161.746469:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264161.746631:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311142656 00000100:00100000:1.0:1789264161.746640:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311142656 00000100:00100000:1.0:1789264161.746692:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 279 00000100:00100000:1.0:1789264161.746701:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:8709:x1876179311142656:12345-192.168.203.44@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789264161.746857:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:8709:x1876179311142656:12345-192.168.203.44@tcp:503:mount.lustre.0 Request processed in 156us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264161.746875:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 279 00000100:00100000:1.0:1789264161.753442:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264161.756248:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311142784 00000100:00100000:0.0:1789264161.756262:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311142784 00000100:00100000:0.0:1789264161.756460:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 280 00000100:00100000:0.0:1789264161.756471:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:8713:x1876179311142784:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789264161.756644:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:8713:x1876179311142784:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 174us (3211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264161.756652:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 280 00000100:00100000:3.0:1789264161.767159:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264161.767263:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311142912 00000100:00100000:2.0:1789264161.767273:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311142912 00000100:00100000:2.0:1789264161.767331:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 281 00000100:00100000:2.0:1789264161.767340:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:8713:x1876179311142912:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789264161.767483:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:8713:x1876179311142912:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 144us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264161.767491:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 281 00000100:00100000:3.0:1789264161.771235:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264161.771325:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311143040 00000100:00100000:0.0:1789264161.771333:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311143040 00000100:00100000:0.0:1789264161.771382:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 282 00000100:00100000:0.0:1789264161.771390:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:8713:x1876179311143040:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789264161.771540:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:8713:x1876179311143040:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 150us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264161.771552:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 282 00000100:00100000:0.0:1789264161.779462:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264161.779676:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311143168 00000100:00100000:1.0:1789264161.779686:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311143168 00000100:00100000:1.0:1789264161.779827:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 283 00000100:00100000:1.0:1789264161.779839:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:8709:x1876179311143168:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789264161.779855:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264161.779871:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8f095200/0xecaf9f2f14ed6cc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bda9e2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264161.779898:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8f095200/0xecaf9f2f14ed6cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9e2 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264161.779908:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8f095200/0xecaf9f2f14ed6cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9e2 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264161.779916:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8f095200, rc 0) 00000100:00100000:1.0:1789264161.779984:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:8709:x1876179311143168:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 148us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264161.779990:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 283 00000100:00100000:3.0:1789264161.781819:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264161.781959:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311143296 00000100:00100000:0.0:1789264161.781968:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311143296 00000100:00100000:0.0:1789264161.782019:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 284 00000100:00100000:0.0:1789264161.782028:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:8709:x1876179311143296:12345-192.168.203.44@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789264161.782047:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789264161.782069:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789264161.782072:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789264161.782075:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789264161.782078:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789264161.782080:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789264161.783554:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:8709:x1876179311143296:12345-192.168.203.44@tcp:256:mount.lustre.0 Request processed in 1512us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264161.783566:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 284 00000100:00100000:3.0:1789264161.786057:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264161.786133:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311143424 00000100:00100000:0.0:1789264161.786142:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311143424 00000100:00100000:0.0:1789264161.786188:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 285 00000100:00100000:0.0:1789264161.786197:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:8709:x1876179311143424:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789264161.786212:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264161.786227:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed6ccd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bda9e9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264161.786251:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed6ccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9e9 expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264161.786278:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed6ccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9e9 expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264161.786286:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366a800, rc 0) 00000100:00100000:0.0:1789264161.786565:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:8709:x1876179311143424:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 367us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264161.786572:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 285 00000100:00100000:3.0:1789264161.788099:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264161.788201:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311143552 00000100:00100000:0.0:1789264161.788208:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311143552 00000100:00100000:0.0:1789264161.788249:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 286 00000100:00100000:0.0:1789264161.788257:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:8709:x1876179311143552:12345-192.168.203.44@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789264161.788366:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:8709:x1876179311143552:12345-192.168.203.44@tcp:501:mount.lustre.0 Request processed in 109us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264161.788372:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 286 00000100:00100000:1.0:1789264161.789843:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264161.789960:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311143680 00000100:00100000:0.0:1789264161.789968:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311143680 00000100:00100000:0.0:1789264161.790049:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 287 00000100:00100000:0.0:1789264161.790059:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:8709:x1876179311143680:12345-192.168.203.44@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789264161.790265:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:8709:x1876179311143680:12345-192.168.203.44@tcp:503:mount.lustre.0 Request processed in 206us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264161.790272:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 287 00000100:00100000:2.0:1789264161.792730:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264161.792839:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311143808 00000100:00100000:3.0:1789264161.792847:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311143808 00000100:00100000:3.0:1789264161.793634:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 288 00000100:00100000:3.0:1789264161.793648:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:8717:x1876179311143808:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789264161.793828:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:8717:x1876179311143808:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 183us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264161.793844:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 288 00000100:00100000:2.0:1789264161.796108:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264161.796235:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311143936 00000100:00100000:0.0:1789264161.796244:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311143936 00000100:00100000:0.0:1789264161.796294:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 289 00000100:00100000:0.0:1789264161.796304:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:8717:x1876179311143936:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789264161.796515:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:8717:x1876179311143936:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 210us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264161.796522:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 289 00000100:00100000:1.0:1789264161.803702:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264161.803882:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264161.807564:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311144576 00000100:00100000:0.0:1789264161.807579:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311144576 00000100:00100000:1.0:1789264161.807629:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264161.807673:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264161.807706:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311144704 00000100:00100000:0.0:1789264161.807709:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311144064 00000100:00100000:1.0:1789264161.807711:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311144704 00000100:00100000:0.0:1789264161.807715:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311144064 00000100:00100000:0.0:1789264161.807727:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311144320 00000100:00100000:0.0:1789264161.807731:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311144320 00000100:00100000:0.0:1789264161.807766:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 86 00000100:00100000:0.0:1789264161.807777:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2404:x1876179311144576:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264161.807867:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2404:x1876179311144576:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 93us (4174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264161.807875:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 86 00000100:00100000:0.0:1789264161.807894:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:0.0:1789264161.807899:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1876179311144064:12345-192.168.203.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789264161.807921:0:6491:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7381f06c-fe63-4f19-bfe0-7d6bc17e625e@192.168.203.44@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:0.0:1789264161.807969:0:6491:0:(genops.c:1385:class_connect()) connect: client 7381f06c-fe63-4f19-bfe0-7d6bc17e625e, cookie 0xecaf9f2f14ed6cd4 00000004:00100000:0.0:1789264161.808080:0:6491:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789264161.808376:0:6491:0:(import.c:65:import_set_state_nolock()) ffff9c3abf630800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789264161.808405:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2401:x1876179311144064:12345-192.168.203.44@tcp:38:mount.lustre.0 Request processed in 505us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264161.808412:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:0.0:1789264161.808425:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:0.0:1789264161.808430:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1876179311144320:12345-192.168.203.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789264161.808453:0:6491:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 7381f06c-fe63-4f19-bfe0-7d6bc17e625e@192.168.203.44@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:0.0:1789264161.808474:0:6491:0:(genops.c:1385:class_connect()) connect: client 7381f06c-fe63-4f19-bfe0-7d6bc17e625e, cookie 0xecaf9f2f14ed6cdb 00000004:00100000:0.0:1789264161.808485:0:6491:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789264161.808539:0:6491:0:(import.c:65:import_set_state_nolock()) ffff9c3abf637000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789264161.808699:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2401:x1876179311144320:12345-192.168.203.44@tcp:38:mount.lustre.0 Request processed in 266us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264161.808707:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00080000:3.0:1789264161.808882:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789264161.808912:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 87 00000100:00100000:1.0:1789264161.808923:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311144704:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264161.808975:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311144704:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 55us (5094us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264161.808983:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 87 00000100:00080000:2.0:1789264161.809077:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264161.818636:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264161.818667:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264161.818737:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264161.818933:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311144832 00000100:00100000:3.0:1789264161.818942:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311144832 00000100:00100000:3.0:1789264161.819050:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311144448 00000100:00100000:3.0:1789264161.819053:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311144448 00000100:00080000:1.0:1789264161.819259:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789264161.819264:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264161.819276:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311144192 00000100:00100000:1.0:1789264161.819280:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311144192 00000100:00100000:1.0:1789264161.819311:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:1.0:1789264161.819320:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+7:8709:x1876179311144832:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789264161.819354:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789264161.819434:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+7:8709:x1876179311144832:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 115us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264161.819442:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:1.0:1789264161.819459:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:1.0:1789264161.819466:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:0:x1876179311144192:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789264161.819477:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789264161.819500:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:0:x1876179311144192:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 33us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264161.819506:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:3.0:1789264161.820025:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:3.0:1789264161.820033:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:0:x1876179311144448:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789264161.820053:0:9197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789264161.820270:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:0:x1876179311144448:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 237us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264161.820277:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:2.0:1789264161.823240:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264161.823394:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311144960 00000100:00100000:1.0:1789264161.823403:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311144960 00000100:00100000:1.0:1789264161.823473:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:1.0:1789264161.823485:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:8709:x1876179311144960:12345-192.168.203.44@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789264161.823564:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:8709:x1876179311144960:12345-192.168.203.44@tcp:40:mount.lustre.0 Request processed in 81us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264161.823571:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:3.0:1789264161.827918:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264161.827970:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311145088 00000100:00100000:0.0:1789264161.827980:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311145088 00000100:00100000:0.0:1789264161.828030:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:0.0:1789264161.828039:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1876179311145088:12345-192.168.203.44@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789264161.828192:0:10317:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7381f06c-fe63-4f19-bfe0-7d6bc17e625e@192.168.203.44@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:0.0:1789264161.828223:0:10317:0:(genops.c:1385:class_connect()) connect: client 7381f06c-fe63-4f19-bfe0-7d6bc17e625e, cookie 0xecaf9f2f14ed6ce2 00002000:00100000:0.0:1789264161.828235:0:10317:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7381f06c-fe63-4f19-bfe0-7d6bc17e625e/ffff9c3abf633000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789264161.828252:0:10317:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789264161.828329:0:10317:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789264161.828367:0:10317:0:(import.c:65:import_set_state_nolock()) ffff9c3abf636800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789264161.828445:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2401:x1876179311145088:12345-192.168.203.44@tcp:8:mount.lustre.0 Request processed in 406us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264161.828453:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:2.0:1789264161.828640:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264161.828690:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264161.828894:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311145216 00000100:00100000:3.0:1789264161.828899:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311145216 00000100:00100000:3.0:1789264161.828931:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:3.0:1789264161.828937:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1876179311145216:12345-192.168.203.44@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789264161.828975:0:8406:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7381f06c-fe63-4f19-bfe0-7d6bc17e625e@192.168.203.44@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:3.0:1789264161.828995:0:8406:0:(genops.c:1385:class_connect()) connect: client 7381f06c-fe63-4f19-bfe0-7d6bc17e625e, cookie 0xecaf9f2f14ed6ce9 00002000:00100000:3.0:1789264161.829002:0:8406:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7381f06c-fe63-4f19-bfe0-7d6bc17e625e/ffff9c3983126800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789264161.829010:0:8406:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789264161.829063:0:8406:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789264161.829268:0:8406:0:(import.c:65:import_set_state_nolock()) ffff9c3983122800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789264161.829314:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2401:x1876179311145216:12345-192.168.203.44@tcp:8:mount.lustre.0 Request processed in 374us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264161.829331:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:0.0:1789264161.829801:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311145344 00000100:00100000:0.0:1789264161.829808:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311145344 00000100:00100000:0.0:1789264161.829886:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:0.0:1789264161.829896:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:8709:x1876179311145344:12345-192.168.203.44@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789264161.829960:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:8709:x1876179311145344:12345-192.168.203.44@tcp:900:mount.lustre.0 Request processed in 65us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264161.829975:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:1.0:1789264161.831466:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264161.831912:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311145472 00000100:00100000:3.0:1789264161.831922:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311145472 00000100:00100000:3.0:1789264161.831981:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:3.0:1789264161.832001:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:8709:x1876179311145472:12345-192.168.203.44@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789264161.832086:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789264161.832165:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:8709:x1876179311145472:12345-192.168.203.44@tcp:33:mount.lustre.0 Request processed in 166us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264161.832172:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 1 00010000:00010000:1.0:1789264162.442212:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264163.337924:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322740224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789264163.338090:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264163.338403:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322740224 00000100:00100000:2.0:1789264163.338413:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322740224 00000100:00100000:2.0:1789264163.338491:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789264163.338510:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322740224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789264163.338553:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264163.338611:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322740224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264163.338620:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789264163.338645:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836e1c00 x1876179322740224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264163.338668:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322740224:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789264163.338730:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789264163.339036:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322740352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789264163.339074:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264163.339335:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322740352 00000100:00100000:1.0:1789264163.339341:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322740352 00000100:00100000:1.0:1789264163.339391:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789264163.339401:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322740352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789264163.339420:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264163.339469:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322740352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264163.339477:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789264163.339500:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39826a2a00 x1876179322740352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264163.339516:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322740352:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789264163.339547:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789264163.466236:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264163.849873:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322740480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789264163.849950:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264163.850026:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322740480 00000100:00100000:2.0:1789264163.850034:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322740480 00000100:00100000:2.0:1789264163.850102:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789264163.850112:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322740480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789264163.850142:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789264163.850186:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322740480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264163.850193:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789264163.850235:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322740480:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789264164.491221:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264165.514066:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264165.897943:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789264165.897963:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322740608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264165.898022:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264165.898152:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322740608 00000100:00100000:2.0:1789264165.898160:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322740608 00000100:00100000:2.0:1789264165.898215:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789264165.898240:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322740608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789264165.898267:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264165.898308:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322740608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264165.898315:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789264165.898351:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836e2d80 x1876179322740608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264165.898367:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322740608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264165.898475:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322740864:0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.898500:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264165.898530:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322741376:0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.898549:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264165.898563:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322741888:0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.898578:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264165.898596:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789264165.898601:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322740992:0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.898619:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264165.898631:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322741504:0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.898651:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264165.898667:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322742016:0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.898683:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264165.898706:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322740864 00000100:00100000:2.0:1789264165.898709:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322740864 00000100:00100000:2.0:1789264165.898728:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322741376 00000100:00100000:2.0:1789264165.898730:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322741376 00000100:00100000:2.0:1789264165.898775:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322741888 00000100:00100000:2.0:1789264165.898779:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322741888 00000100:00100000:2.0:1789264165.898791:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322741504 00000100:00100000:2.0:1789264165.898793:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322741504 00000100:00100000:2.0:1789264165.898802:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322742016 00000100:00100000:2.0:1789264165.898804:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322742016 00000100:00100000:2.0:1789264165.898816:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789264165.898822:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322740864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.898856:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322740864:12345-0@lo:400:kworker.0 Request processed in 34us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264165.898862:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789264165.898874:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789264165.898881:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322741376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.898903:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322741376:12345-0@lo:400:kworker.0 Request processed in 24us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264165.898908:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789264165.898917:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789264165.898937:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322741888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.899043:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322741888:12345-0@lo:400:kworker.0 Request processed in 119us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264165.899049:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789264165.899061:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789264165.899069:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322741504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.899096:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322741504:12345-0@lo:400:kworker.0 Request processed in 30us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264165.899102:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789264165.899112:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789264165.899128:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322742016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.899153:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322742016:12345-0@lo:400:kworker.0 Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264165.899158:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789264165.899180:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322740992 00000100:00100000:2.0:1789264165.899182:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322740992 00000100:00100000:0.0:1789264165.899296:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322741120:0@lo:400:kworker.0 00000100:00100000:0.0:1789264165.899334:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264165.899353:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322741632:0@lo:400:kworker.0 00000100:00100000:0.0:1789264165.899375:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264165.899391:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322742144:0@lo:400:kworker.0 00000100:00100000:0.0:1789264165.899412:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264165.899436:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789264165.899443:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322740736:0@lo:400:kworker.0 00000100:00100000:0.0:1789264165.899467:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264165.899498:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322740736 00000100:00100000:0.0:1789264165.899500:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322741248:0@lo:400:kworker.0 00000100:00100000:3.0:1789264165.899516:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322740736 00000100:00100000:3.0:1789264165.899555:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789264165.899563:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322740736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264165.899601:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322740736:12345-0@lo:400:kworker.0 Request processed in 39us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264165.899610:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789264165.899612:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789264165.899624:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322740992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.899663:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322740992:12345-0@lo:400:kworker.0 Request processed in 43us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264165.899670:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789264165.899689:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322741120 00000100:00100000:2.0:1789264165.899692:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322741120 00000100:00100000:2.0:1789264165.899719:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789264165.899726:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322741120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.899777:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322741120:12345-0@lo:400:kworker.0 Request processed in 52us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264165.899783:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789264165.899820:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322740992:0@lo:400:kworker.0 00010000:00080000:2.0:1789264165.899834:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c61500 x1876179322741504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264165.899843:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322741504:0@lo:400:kworker.0 00010000:00080000:2.0:1789264165.899853:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983726300 x1876179322742016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264165.899860:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322742016:0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.899881:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322740864:0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.899890:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322741376:0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.899899:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322741888:0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.899959:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322741632 00000100:00100000:2.0:1789264165.899963:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322741632 00000100:00100000:2.0:1789264165.899989:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322742144 00000100:00100000:2.0:1789264165.899993:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322742144 00000100:00100000:2.0:1789264165.900017:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789264165.900024:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322741632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.900055:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322741632:12345-0@lo:400:kworker.0 Request processed in 33us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264165.900061:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789264165.900071:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789264165.900078:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322742144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.900105:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322742144:12345-0@lo:400:kworker.0 Request processed in 29us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264165.900110:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789264165.900199:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264165.900227:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322741760:0@lo:400:kworker.0 00000100:00100000:0.0:1789264165.900255:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264165.900288:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322742272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264165.900291:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322741760 00000100:00100000:3.0:1789264165.900297:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322741760 00000100:00100000:0.0:1789264165.900318:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264165.900331:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789264165.900341:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322741760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264165.900348:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322741120:0@lo:400:kworker.0 00010000:00080000:0.0:1789264165.900362:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983725c00 x1876179322741632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264165.900372:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322741632:0@lo:400:kworker.0 00000100:00100000:3.0:1789264165.900380:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322741760:12345-0@lo:400:kworker.0 Request processed in 41us (123us total) trans 0 rc 0/0 00010000:00080000:0.0:1789264165.900385:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983727100 x1876179322742144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264165.900392:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789264165.900401:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322742144:0@lo:400:kworker.0 00000100:00100000:0.0:1789264165.900423:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322740736:0@lo:400:kworker.0 00010000:00080000:0.0:1789264165.900432:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983727800 x1876179322741760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264165.900439:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322741760:0@lo:400:kworker.0 00000100:00080000:1.0:1789264165.900532:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789264165.900537:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789264165.900540:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789264165.900543:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789264165.900556:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322742272 00000100:00100000:1.0:1789264165.900560:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322742272 00000100:00100000:1.0:1789264165.900597:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789264165.900611:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322742272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789264165.900624:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264165.900659:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322742272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264165.900664:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789264165.900684:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39826a2a00 x1876179322742272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264165.900697:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322742272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264165.900871:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322741248 00000100:00100000:2.0:1789264165.900875:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322741248 00000100:00100000:2.0:1789264165.900951:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789264165.900959:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322741248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264165.901000:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322741248:12345-0@lo:400:kworker.0 Request processed in 43us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264165.901007:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789264165.901052:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322741248:0@lo:400:kworker.0 00000001:02000400:2.0:1789264166.274021:0:12154:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1789264166.410154:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789264166.410177:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322742400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789264166.410243:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264166.410301:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322742400 00000100:00100000:0.0:1789264166.410308:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322742400 00000100:00100000:0.0:1789264166.410362:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789264166.410371:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322742400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789264166.410401:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789264166.410445:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322742400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264166.410464:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789264166.410506:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322742400:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789264166.537982:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264166.861798:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264166.861838:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264166.861859:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264166.861906:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264166.861944:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264166.861969:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264166.861986:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311145728 00000100:00100000:3.0:1789264166.862000:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264166.862001:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311145728 00000100:00100000:3.0:1789264166.862037:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311146240 00000100:00100000:3.0:1789264166.862046:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311146240 00000100:00100000:0.0:1789264166.862054:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311145984 00000100:00100000:0.0:1789264166.862058:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311145984 00000100:00100000:2.0:1789264166.862100:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311145856 00000100:00100000:0.0:1789264166.862102:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311146112 00000100:00100000:2.0:1789264166.862108:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311145856 00000100:00100000:0.0:1789264166.862109:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311146112 00000100:00100000:3.0:1789264166.862114:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311146368 00000100:00100000:3.0:1789264166.862120:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311146368 00000100:00100000:0.0:1789264166.862147:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 94 00000100:00100000:0.0:1789264166.862160:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2403:x1876179311145728:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264166.862162:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:3.0:1789264166.862173:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2403:x1876179311146240:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264166.862191:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 95 00000100:00100000:2.0:1789264166.862206:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2403:x1876179311145984:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264166.862893:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2403:x1876179311146240:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 716us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264166.862905:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:2.0:1789264166.862914:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2403:x1876179311145984:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 707us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264166.862935:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 95 00000100:00100000:3.0:1789264166.862950:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:3.0:1789264166.862966:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2403:x1876179311146368:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264166.862975:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 96 00000100:00100000:2.0:1789264166.862987:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2403:x1876179311146112:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264166.863015:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2403:x1876179311146368:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 53us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264166.863024:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:2.0:1789264166.863037:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2403:x1876179311146112:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 48us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264166.863046:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 96 00000100:00100000:3.0:1789264166.863061:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 97 00000100:00100000:3.0:1789264166.863072:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2403:x1876179311145856:12345-192.168.203.44@tcp:400:kworker.0 00000100:00080000:2.0:1789264166.863078:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789264166.863084:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789264166.863087:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789264166.863090:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789264166.863256:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2403:x1876179311145856:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 185us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264166.863266:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 97 00000100:00100000:3.0:1789264166.864880:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311145600 00000100:00100000:3.0:1789264166.864899:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311145600 00000100:00100000:3.0:1789264166.864986:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 291 00000100:00100000:3.0:1789264166.865016:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2403:x1876179311145600:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264166.865104:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2403:x1876179311145600:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 91us (3197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264166.865111:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 291 00000100:00100000:0.0:1789264166.866319:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2403:x1876179311145728:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 4148us (4521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264166.866483:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 94 00000001:00100000:1.0:1789264167.438130:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7381f06c-fe63-4f19-bfe0-7d6bc17e625e 00000001:00100000:1.0:1789264167.438466:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7381f06c-fe63-4f19-bfe0-7d6bc17e625e 00000001:00100000:1.0:1789264167.438607:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7381f06c-fe63-4f19-bfe0-7d6bc17e625e 00000001:00100000:1.0:1789264167.439515:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7381f06c-fe63-4f19-bfe0-7d6bc17e625e 00010000:00010000:2.0:1789264167.562010:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264168.459028:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789264168.459048:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322742528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789264168.459107:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264168.459386:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322742528 00000100:00100000:2.0:1789264168.459394:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322742528 00000100:00100000:2.0:1789264168.459494:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789264168.459505:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322742528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789264168.459534:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264168.459596:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322742528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264168.459603:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789264168.459632:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789264168.459641:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322742656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789264168.459670:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264168.459701:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322742656 00000100:00100000:2.0:1789264168.459705:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322742656 00000100:00080000:3.0:1789264168.460023:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789264168.460126:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789264168.460133:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322742656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789264168.460147:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264168.460180:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322742656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264168.460186:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789264168.460222:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983d5ca80 x1876179322742656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264168.460240:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322742656:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789264168.460272:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836e0700 x1876179322742528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264168.460286:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322742528:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789264168.586937:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264168.969954:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322742784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789264168.970030:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264168.970712:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322742784 00000100:00100000:0.0:1789264168.970721:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322742784 00000100:00100000:0.0:1789264168.970849:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789264168.970860:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322742784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789264168.970893:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789264168.970971:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322742784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264168.970978:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789264168.971059:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322742784:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789264169.610074:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264170.633988:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264171.018114:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322743168:0@lo:400:kworker.0 00000100:00100000:3.0:1789264171.018179:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264171.018222:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322743680:0@lo:400:kworker.0 00000100:00100000:3.0:1789264171.018247:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264171.018268:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322744192:0@lo:400:kworker.0 00000100:00100000:3.0:1789264171.018288:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264171.018314:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789264171.018320:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322743296:0@lo:400:kworker.0 00000100:00100000:3.0:1789264171.018340:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264171.018354:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322743808:0@lo:400:kworker.0 00000100:00100000:3.0:1789264171.018372:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264171.018390:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322744320:0@lo:400:kworker.0 00000100:00100000:3.0:1789264171.018408:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264171.018444:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322743808 00000100:00100000:3.0:1789264171.018451:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322743808 00000100:00100000:3.0:1789264171.018507:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322744320 00000100:00100000:3.0:1789264171.018511:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322744320 00000100:00100000:3.0:1789264171.018532:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789264171.018545:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322743808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264171.018591:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322743808:12345-0@lo:400:kworker.0 Request processed in 52us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264171.018597:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789264171.018613:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789264171.018619:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322744320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264171.018641:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322744320:12345-0@lo:400:kworker.0 Request processed in 24us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264171.018647:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789264171.018660:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789264171.018663:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789264171.018684:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ababbfb80 x1876179322743808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264171.018697:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322743808:0@lo:400:kworker.0 00010000:00080000:3.0:1789264171.018706:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983cd0a80 x1876179322744320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264171.018713:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322744320:0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.021420:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322742912:0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.021476:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264171.021515:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322743424:0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.021538:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264171.021560:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322743936:0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.021578:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264171.021592:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322744448:0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.021620:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264171.021641:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789264171.021647:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322743040:0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.021665:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264171.021678:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322743552:0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.021694:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264171.021706:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322744064:0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.021720:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264171.021728:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322744576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264171.021764:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264171.021794:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322743168 00000100:00100000:2.0:1789264171.021800:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322743168 00000100:00100000:2.0:1789264171.021840:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322743424 00000100:00100000:2.0:1789264171.021842:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322743424 00000100:00100000:2.0:1789264171.021855:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789264171.021861:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322743168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.021918:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322743168:12345-0@lo:400:kworker.0 Request processed in 56us (3739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.021925:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789264171.021938:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789264171.021944:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322743424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.021983:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322743424:12345-0@lo:400:kworker.0 Request processed in 40us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.021989:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789264171.022003:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322743680 00000100:00100000:2.0:1789264171.022006:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322743680 00000100:00100000:2.0:1789264171.022035:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322744192 00000100:00100000:2.0:1789264171.022038:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322744192 00000100:00100000:2.0:1789264171.022048:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322743296 00000100:00100000:2.0:1789264171.022051:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322743296 00000100:00100000:2.0:1789264171.022059:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322743040 00000100:00100000:2.0:1789264171.022061:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322743040 00000100:00100000:2.0:1789264171.022068:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322743552 00000100:00100000:2.0:1789264171.022070:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322743552 00000100:00100000:2.0:1789264171.022079:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322744064 00000100:00100000:2.0:1789264171.022081:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322744064 00000100:00100000:2.0:1789264171.022093:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789264171.022098:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322743680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.022124:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322743680:12345-0@lo:400:kworker.0 Request processed in 26us (3877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.022129:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789264171.022140:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789264171.022146:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322744192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.022171:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322744192:12345-0@lo:400:kworker.0 Request processed in 26us (3882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.022176:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789264171.022187:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789264171.022194:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322743296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.022219:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322743296:12345-0@lo:400:kworker.0 Request processed in 26us (3878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.022224:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789264171.022234:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789264171.022240:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322743040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.022264:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322743040:12345-0@lo:400:kworker.0 Request processed in 25us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.022275:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789264171.022287:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789264171.022294:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322743552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.022321:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322743552:12345-0@lo:400:kworker.0 Request processed in 29us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.022327:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789264171.022338:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789264171.022344:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322744064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.022384:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322744064:12345-0@lo:400:kworker.0 Request processed in 40us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.022389:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789264171.022414:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322743936 00000100:00100000:2.0:1789264171.022417:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322743936 00000100:00100000:2.0:1789264171.022439:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322744448 00000100:00100000:2.0:1789264171.022441:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322744448 00000100:00100000:2.0:1789264171.022454:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789264171.022459:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322743936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.022486:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322743936:12345-0@lo:400:kworker.0 Request processed in 27us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.022491:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789264171.022501:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789264171.022508:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322744448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.022532:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322744448:12345-0@lo:400:kworker.0 Request processed in 26us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.022536:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789264171.022572:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322744576 00000100:00100000:2.0:1789264171.022576:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322744576 00000100:00100000:2.0:1789264171.022604:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789264171.022612:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322744576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789264171.022630:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264171.022659:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322744576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.022665:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789264171.022683:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789264171.022686:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789264171.022689:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789264171.022691:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789264171.022736:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322743040:0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.022765:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322743552:0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.022775:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322744064:0@lo:400:kworker.0 00010000:00080000:2.0:1789264171.022785:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836e1c00 x1876179322744576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264171.022798:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322744576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264171.022806:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322743424:0@lo:400:kworker.0 00010000:00080000:2.0:1789264171.022815:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ababbdc00 x1876179322743936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264171.022822:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322743936:0@lo:400:kworker.0 00010000:00080000:2.0:1789264171.022829:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983cd0700 x1876179322744448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264171.022850:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322744448:0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.022900:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322744704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264171.022930:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264171.022957:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322743296:0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.022969:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322743168:0@lo:400:kworker.0 00010000:00080000:2.0:1789264171.022978:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ababbc380 x1876179322743680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264171.022985:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322743680:0@lo:400:kworker.0 00010000:00080000:2.0:1789264171.022994:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983cd1880 x1876179322744192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264171.023001:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322744192:0@lo:400:kworker.0 00000100:00100000:2.0:1789264171.023027:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322744704 00000100:00100000:2.0:1789264171.023030:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322744704 00000100:00100000:2.0:1789264171.023053:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789264171.023060:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322744704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789264171.023070:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264171.023098:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322744704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.023103:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1789264171.023126:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39826a2680 x1876179322744704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264171.023138:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322744704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264171.023899:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322742912 00000100:00100000:3.0:1789264171.023906:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322742912 00000100:00100000:3.0:1789264171.023950:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789264171.023959:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322742912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264171.024090:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322742912:12345-0@lo:400:kworker.0 Request processed in 132us (2612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264171.024105:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789264171.024165:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322742912:0@lo:400:kworker.0 00000020:00000004:2.0:1789264171.223405:0:12469:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789264171.223626:0:12469:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789264171.529876:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789264171.529908:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322744832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789264171.529983:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264171.530069:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322744832 00000100:00100000:1.0:1789264171.530078:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322744832 00000100:00100000:1.0:1789264171.530139:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789264171.530149:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322744832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789264171.530180:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789264171.530224:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322744832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264171.530244:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789264171.530314:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322744832:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789264171.658072:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264171.984047:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264171.984106:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264171.984170:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311146496 00000100:00100000:3.0:1789264171.984180:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311146496 00000100:00100000:3.0:1789264171.984237:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 293 00000100:00100000:3.0:1789264171.984248:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2404:x1876179311146496:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264171.984328:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2404:x1876179311146496:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264171.984335:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 293 00000100:00100000:2.0:1789264171.985946:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311146624 00000100:00100000:2.0:1789264171.985959:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311146624 00000100:00080000:3.0:1789264171.986112:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264171.986657:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 104 00000100:00100000:2.0:1789264171.986670:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2404:x1876179311146624:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264171.986917:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2404:x1876179311146624:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 250us (2808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.986926:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 104 00000100:00100000:2.0:1789264171.991540:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264171.991657:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264171.991678:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264171.991695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264171.991715:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264171.991739:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311146880 00000100:00100000:2.0:1789264171.991772:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311146880 00000100:00100000:2.0:1789264171.991834:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311146752 00000100:00100000:2.0:1789264171.991838:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311146752 00000100:00100000:2.0:1789264171.991857:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311147008 00000100:00100000:2.0:1789264171.991860:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311147008 00000100:00100000:2.0:1789264171.991877:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 105 00000100:00100000:2.0:1789264171.991898:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311146880:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264171.991962:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311146880:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 66us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.991969:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 105 00000100:00100000:2.0:1789264171.991984:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 106 00000100:00100000:2.0:1789264171.992002:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311146752:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264171.992027:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311146752:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.992035:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 106 00000100:00100000:2.0:1789264171.992048:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 107 00000100:00100000:2.0:1789264171.992054:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311147008:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264171.992076:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311147008:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 23us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.992082:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 107 00000100:00100000:2.0:1789264171.992100:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311147136 00000100:00100000:2.0:1789264171.992104:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311147136 00000100:00100000:2.0:1789264171.992135:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311147264 00000100:00100000:2.0:1789264171.992139:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311147264 00000100:00100000:2.0:1789264171.992157:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:2.0:1789264171.992163:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311147136:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264171.992187:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311147136:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.992193:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:2.0:1789264171.992202:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:2.0:1789264171.992207:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311147264:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264171.992225:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311147264:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 18us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264171.992231:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00080000:2.0:1789264171.992262:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789264171.992271:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789264171.992273:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789264171.992275:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:2.0:1789264172.525509:0:12566:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789264172.526017:0:12566:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789264172.681962:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264173.581478:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322744960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789264173.581548:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264173.581606:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322745088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789264173.581628:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264173.581671:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322744960 00000100:00100000:1.0:1789264173.581679:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322744960 00000100:00100000:0.0:1789264173.581723:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322745088 00000100:00100000:0.0:1789264173.581729:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322745088 00000100:00100000:1.0:1789264173.581737:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789264173.581770:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322744960:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789264173.581781:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789264173.581791:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322745088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789264173.581800:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1789264173.581818:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264173.581850:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322744960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264173.581858:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789264173.581863:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322745088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264173.581883:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1789264173.581895:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789264173.581931:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836e0700 x1876179322744960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264173.581949:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322744960:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789264173.581961:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39826a1880 x1876179322745088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264173.581973:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322745088:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789264173.705997:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789264173.853242:0:12664:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789264173.853462:0:12664:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789264174.090356:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789264174.090383:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322745216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789264174.090456:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264174.090529:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322745216 00000100:00100000:2.0:1789264174.090538:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322745216 00000100:00100000:2.0:1789264174.090598:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789264174.090609:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322745216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789264174.090642:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789264174.090695:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322745216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264174.090703:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789264174.090779:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322745216:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789264174.729941:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789264175.215372:0:12762:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789264175.215559:0:12762:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789264175.753969:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264176.138550:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322745472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264176.139165:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322745344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264176.139219:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264176.139458:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322745344 00000100:00100000:0.0:1789264176.139465:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322745344 00000100:00100000:0.0:1789264176.139630:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789264176.139641:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322745344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789264176.139672:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264176.139840:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322745344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 201us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264176.139847:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789264176.139884:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322745728:0@lo:400:kworker.0 00000100:00100000:0.0:1789264176.139913:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264176.139934:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322746240:0@lo:400:kworker.0 00000100:00100000:0.0:1789264176.139958:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264176.139979:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789264176.139985:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322745600:0@lo:400:kworker.0 00000100:00100000:0.0:1789264176.140010:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264176.140034:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322746112:0@lo:400:kworker.0 00000100:00100000:0.0:1789264176.140059:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789264176.140083:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789264176.140238:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322745728 00000100:00100000:0.0:1789264176.140249:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322745728 00000100:00100000:0.0:1789264176.140277:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322746240 00000100:00100000:0.0:1789264176.140280:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322746240 00000100:00100000:0.0:1789264176.140301:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789264176.140307:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322745728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264176.140352:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322745728:12345-0@lo:400:kworker.0 Request processed in 45us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264176.140359:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789264176.140374:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789264176.140381:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322746240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264176.140410:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322746240:12345-0@lo:400:kworker.0 Request processed in 30us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264176.140416:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789264176.140436:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322745600 00000100:00100000:0.0:1789264176.140439:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322745600 00000100:00100000:0.0:1789264176.140463:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789264176.140470:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3623:x1876179322745600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264176.140499:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3623:x1876179322745600:12345-0@lo:400:kworker.0 Request processed in 30us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264176.140724:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264176.140776:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322745984:0@lo:400:kworker.0 00000100:00100000:2.0:1789264176.140810:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322746624:0@lo:400:kworker.0 00000100:00100000:1.0:1789264176.140810:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264176.140836:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322746496:0@lo:400:kworker.0 00000100:00100000:2.0:1789264176.140848:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264176.140883:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264176.140890:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789264176.140899:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322746752:0@lo:400:kworker.0 00000100:00100000:1.0:1789264176.140912:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789264176.140920:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322745856:0@lo:400:kworker.0 00000100:00100000:1.0:1789264176.140944:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264176.140961:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322746368:0@lo:400:kworker.0 00000100:00100000:1.0:1789264176.140979:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264176.140993:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1876179322746880:0@lo:400:kworker.0 00000100:00100000:1.0:1789264176.141013:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264176.141039:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322745472 00000100:00100000:1.0:1789264176.141044:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322745472 00000100:00100000:1.0:1789264176.141073:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789264176.141080:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322745472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789264176.141094:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264176.141138:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322745472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264176.141139:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264176.141155:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789264176.141167:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322745984 00000100:00100000:2.0:1789264176.141172:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322745984 00000100:00100000:1.0:1789264176.141181:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322746368 00000100:00100000:1.0:1789264176.141187:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322746368 00000100:00100000:2.0:1789264176.141199:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322746880 00000100:00100000:2.0:1789264176.141204:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322746880 00000100:00100000:1.0:1789264176.141214:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322746752 00000100:00100000:1.0:1789264176.141220:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322746752 00000100:00100000:2.0:1789264176.141228:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789264176.141237:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322745984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264176.141245:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789264176.141255:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322746368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264176.141273:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322745984:12345-0@lo:400:kworker.0 Request processed in 37us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264176.141286:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789264176.141304:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322746368:12345-0@lo:400:kworker.0 Request processed in 50us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264176.141305:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789264176.141316:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789264176.141333:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789264176.141340:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322746752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264176.141372:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322746752:12345-0@lo:400:kworker.0 Request processed in 33us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264176.141378:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789264176.141396:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322746624 00000100:00100000:1.0:1789264176.141399:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322746624 00000100:00100000:1.0:1789264176.141422:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322746496 00000100:00100000:1.0:1789264176.141425:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322746496 00000100:00100000:1.0:1789264176.141440:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789264176.141445:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322746624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264176.141474:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322746624:12345-0@lo:400:kworker.0 Request processed in 28us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264176.141480:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789264176.141491:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789264176.141497:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322746496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264176.141534:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322746496:12345-0@lo:400:kworker.0 Request processed in 37us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264176.141540:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789264176.141560:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322746112 00000100:00100000:1.0:1789264176.141564:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322746112 00000100:00100000:1.0:1789264176.141587:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322745856 00000100:00100000:1.0:1789264176.141589:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322745856 00000100:00100000:1.0:1789264176.141600:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789264176.141605:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322746112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264176.142004:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876179322746880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264176.142046:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876179322746880:12345-0@lo:400:kworker.0 Request processed in 732us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264176.142052:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:2.0:1789264176.142095:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836fd180 x1876179322745344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264176.142114:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322745344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264176.142209:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322746112:12345-0@lo:400:kworker.0 Request processed in 602us (2149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264176.142217:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789264176.142232:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789264176.142239:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322745856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264176.142268:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322745856:12345-0@lo:400:kworker.0 Request processed in 31us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264176.142274:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789264176.142305:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322746752:0@lo:400:kworker.0 00010000:00080000:1.0:1789264176.142317:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836fca80 x1876179322746624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264176.142326:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322746624:0@lo:400:kworker.0 00000100:00100000:1.0:1789264176.142370:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322745856:0@lo:400:kworker.0 00010000:00080000:1.0:1789264176.142385:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836ff480 x1876179322746368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264176.142395:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322746368:0@lo:400:kworker.0 00010000:00080000:1.0:1789264176.142420:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836ff800 x1876179322746880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789264176.142431:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264176.142432:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1876179322746880:0@lo:400:kworker.0 00000100:00080000:2.0:1789264176.142438:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789264176.142442:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789264176.142445:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264176.142449:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322745984:0@lo:400:kworker.0 00010000:00080000:1.0:1789264176.142463:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836fd880 x1876179322746496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264176.142472:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322746496:0@lo:400:kworker.0 00000100:00100000:2.0:1789264176.142478:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322745600:0@lo:400:kworker.0 00000100:00100000:0.0:1789264176.142486:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00010000:00080000:1.0:1789264176.142490:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39826a0a80 x1876179322745472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264176.142496:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322746112:0@lo:400:kworker.0 00000100:00100000:1.0:1789264176.142514:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322745472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264176.142517:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322745728:0@lo:400:kworker.0 00000100:00100000:2.0:1789264176.142536:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322746240:0@lo:400:kworker.0 00000020:00000004:2.0:1789264176.443080:0:12859:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789264176.443305:0:12859:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789264176.650874:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322747008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789264176.650951:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264176.651236:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322747008 00000100:00100000:2.0:1789264176.651244:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322747008 00000100:00100000:2.0:1789264176.651318:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789264176.651328:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322747008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789264176.651360:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789264176.651432:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322747008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264176.651439:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789264176.651823:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322747008:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789264176.777935:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264177.102511:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264177.102600:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264177.102636:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264177.102658:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264177.102734:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264177.102783:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311147648 00000100:00100000:2.0:1789264177.102792:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311147648 00000100:00100000:2.0:1789264177.102856:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311147520 00000100:00100000:2.0:1789264177.102859:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311147520 00000100:00100000:2.0:1789264177.102882:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311147776 00000100:00100000:2.0:1789264177.102885:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311147776 00000100:00100000:2.0:1789264177.102910:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 114 00000100:00100000:2.0:1789264177.102920:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2403:x1876179311147648:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264177.102990:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2403:x1876179311147648:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 72us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264177.102998:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 114 00000100:00100000:2.0:1789264177.103015:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 115 00000100:00100000:2.0:1789264177.103024:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311147520:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264177.104267:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311147392 00000100:00100000:3.0:1789264177.104277:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311147392 00000100:00100000:3.0:1789264177.104320:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 295 00000100:00100000:3.0:1789264177.104329:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2403:x1876179311147392:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264177.104374:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2403:x1876179311147392:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 47us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264177.104381:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 295 00000100:00100000:3.0:1789264177.104434:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 116 00000100:00100000:3.0:1789264177.104443:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311147776:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264177.104470:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311147776:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 29us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264177.104477:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 116 00000100:00080000:3.0:1789264177.104497:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789264177.104502:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789264177.104512:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311148032 00000100:00100000:2.0:1789264177.104520:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311147520:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 1496us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264177.104523:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311148032 00000100:00100000:2.0:1789264177.104532:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 115 00000100:00100000:3.0:1789264177.104568:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:3.0:1789264177.104577:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311148032:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264177.104607:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311148032:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 32us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264177.105230:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264177.105271:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311147904 00000100:00100000:0.0:1789264177.105277:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311147904 00000100:00100000:2.0:1789264177.105287:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264177.105293:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:3.0:1789264177.105316:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311148160 00000100:00100000:3.0:1789264177.105321:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311148160 00000100:00100000:0.0:1789264177.105326:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 117 00000100:00100000:0.0:1789264177.105338:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2403:x1876179311147904:12345-192.168.203.44@tcp:400:kworker.0 00000100:00080000:2.0:1789264177.105353:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789264177.105359:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789264177.105360:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00080000:2.0:1789264177.105365:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789264177.105372:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2403:x1876179311148160:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264177.105492:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2403:x1876179311148160:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 122us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264177.105494:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2403:x1876179311147904:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 156us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264177.105509:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:0.0:1789264177.105510:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 117 00010000:00010000:2.0:1789264177.801925:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264178.698104:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322747136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789264178.698171:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264178.698922:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322747136 00000100:00100000:0.0:1789264178.698931:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322747136 00000100:00100000:0.0:1789264178.698988:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789264178.698997:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322747136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789264178.699025:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264178.700236:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322747264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789264178.700283:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789264178.700335:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789264178.700356:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322747264 00000100:00100000:3.0:1789264178.700361:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322747264 00000100:00100000:3.0:1789264178.700396:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789264178.700403:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322747264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789264178.700418:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264178.700452:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322747264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264178.700459:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1789264178.700476:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789264178.700499:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836fea00 x1876179322747264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264178.700523:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322747264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789264178.703023:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322747136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4019us (4842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264178.703037:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789264178.706716:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39826a2680 x1876179322747136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264178.706766:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322747136:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789264178.825922:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789264178.984119:0:13003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789264179.212232:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789264179.212255:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322747392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789264179.212321:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264179.212436:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322747392 00000100:00100000:2.0:1789264179.212443:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322747392 00000100:00100000:2.0:1789264179.212503:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789264179.212515:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322747392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789264179.212546:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789264179.212597:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322747392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264179.212603:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789264179.212680:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322747392:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789264179.850435:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264180.883084:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264181.257949:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322747904:0@lo:400:kworker.0 00000100:00100000:1.0:1789264181.257990:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322747520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789264181.258026:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264181.258046:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264181.258096:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322748160:0@lo:400:kworker.0 00000100:00100000:3.0:1789264181.258101:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322748416:0@lo:400:kworker.0 00000100:00100000:3.0:1789264181.258131:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264181.258147:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264181.258150:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322748928:0@lo:400:kworker.0 00000100:00100000:3.0:1789264181.258172:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264181.258178:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322748672:0@lo:400:kworker.0 00000100:00100000:3.0:1789264181.258190:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789264181.258196:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322747648:0@lo:400:kworker.0 00000100:00100000:1.0:1789264181.258214:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264181.258222:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264181.258246:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322748032:0@lo:400:kworker.0 00000100:00100000:1.0:1789264181.258252:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322749184:0@lo:400:kworker.0 00000100:00100000:3.0:1789264181.258267:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264181.258286:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264181.258289:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322748544:0@lo:400:kworker.0 00000100:00100000:1.0:1789264181.258310:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789264181.258319:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322747776:0@lo:400:kworker.0 00000100:00100000:3.0:1789264181.258320:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264181.258331:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322747904 00000100:00100000:0.0:1789264181.258340:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322747904 00000100:00100000:3.0:1789264181.258348:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322749056:0@lo:400:kworker.0 00000100:00100000:1.0:1789264181.258355:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264181.258382:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264181.258382:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322748288:0@lo:400:kworker.0 00000100:00100000:0.0:1789264181.258385:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322748160 00000100:00100000:0.0:1789264181.258390:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322748160 00000100:00100000:0.0:1789264181.258413:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789264181.258419:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264181.258424:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322747904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264181.258443:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322748800:0@lo:400:kworker.0 00000100:00100000:3.0:1789264181.258444:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322747520 00000100:00100000:3.0:1789264181.258451:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322747520 00000100:00100000:1.0:1789264181.258482:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264181.258496:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322747904:12345-0@lo:400:kworker.0 Request processed in 73us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264181.258499:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789264181.258509:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789264181.258515:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322747520:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789264181.258532:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00002000:00000024:3.0:1789264181.258539:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264181.258544:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322748160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264181.258558:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322748672 00000100:00100000:1.0:1789264181.258563:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322748672 00000100:00100000:0.0:1789264181.258591:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322748160:12345-0@lo:400:kworker.0 Request processed in 51us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264181.258597:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322747520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264181.258602:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789264181.258610:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322749184 00000100:00100000:1.0:1789264181.258615:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322749184 00000100:00100000:3.0:1789264181.258618:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789264181.258637:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322748544 00000100:00100000:0.0:1789264181.258642:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322748544 00000100:00100000:3.0:1789264181.258644:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322748416 00000100:00100000:1.0:1789264181.258647:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322749056 00000100:00100000:3.0:1789264181.258649:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322748416 00000100:00100000:1.0:1789264181.258653:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322749056 00000100:00100000:0.0:1789264181.258670:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789264181.258681:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322748672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264181.258682:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322748928 00000100:00100000:3.0:1789264181.258688:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322748928 00000100:00100000:1.0:1789264181.258689:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789264181.258701:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322749184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264181.258719:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322748032 00000100:00100000:3.0:1789264181.258723:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322748032 00000100:00100000:0.0:1789264181.258731:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322748672:12345-0@lo:400:kworker.0 Request processed in 53us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264181.258772:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322749184:12345-0@lo:400:kworker.0 Request processed in 48us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264181.258774:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322747776 00000100:00100000:3.0:1789264181.258780:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322747776 00000100:00100000:0.0:1789264181.258781:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789264181.258801:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322748288 00000100:00100000:3.0:1789264181.258805:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322748288 00000100:00100000:3.0:1789264181.258830:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322748800 00000100:00100000:3.0:1789264181.258834:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322748800 00000100:00100000:3.0:1789264181.258855:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789264181.258864:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322748416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264181.258884:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789264181.258898:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322748928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264181.258903:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322748416:12345-0@lo:400:kworker.0 Request processed in 39us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264181.258912:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789264181.258926:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789264181.258935:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322748032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264181.258949:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322748928:12345-0@lo:400:kworker.0 Request processed in 55us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264181.258962:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789264181.258972:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322748032:12345-0@lo:400:kworker.0 Request processed in 38us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264181.258980:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789264181.259343:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789264181.259352:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789264181.259356:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322747776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264181.259368:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322748288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264181.259411:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322747776:12345-0@lo:400:kworker.0 Request processed in 56us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264181.259416:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322748288:12345-0@lo:400:kworker.0 Request processed in 51us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264181.259423:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789264181.259431:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789264181.259457:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789264181.259466:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789264181.259476:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322748544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264181.259478:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789264181.259500:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322749056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264181.259516:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322748544:12345-0@lo:400:kworker.0 Request processed in 42us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264181.259523:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789264181.259547:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322749056:12345-0@lo:400:kworker.0 Request processed in 59us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264181.259561:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789264181.259908:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789264181.259917:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322748800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264181.259964:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322748800:12345-0@lo:400:kworker.0 Request processed in 50us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264181.259970:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789264181.260014:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322747648 00000100:00100000:2.0:1789264181.260020:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322747648 00000100:00100000:2.0:1789264181.260062:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789264181.260069:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322747648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264181.260099:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322747648:12345-0@lo:400:kworker.0 Request processed in 31us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264181.260105:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:2.0:1789264181.260156:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789264181.260161:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789264181.260164:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789264181.260173:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789264181.260202:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322747648:0@lo:400:kworker.0 00000100:00100000:2.0:1789264181.260220:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322748032:0@lo:400:kworker.0 00010000:00080000:2.0:1789264181.260235:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ab301ca80 x1876179322748544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264181.260241:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322749312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264181.260255:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322748544:0@lo:400:kworker.0 00010000:00080000:2.0:1789264181.260269:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398374e680 x1876179322749056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264181.260278:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322749056:0@lo:400:kworker.0 00000100:00100000:3.0:1789264181.260284:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789264181.260297:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ab301df80 x1876179322748416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264181.260321:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322748416:0@lo:400:kworker.0 00010000:00080000:2.0:1789264181.260340:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398374df80 x1876179322748928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264181.260348:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322748928:0@lo:400:kworker.0 00000100:00100000:2.0:1789264181.260358:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322747904:0@lo:400:kworker.0 00000100:00100000:2.0:1789264181.260410:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322747776:0@lo:400:kworker.0 00000100:00100000:0.0:1789264181.260410:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322749312 00000100:00100000:0.0:1789264181.260417:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322749312 00000100:00100000:2.0:1789264181.260426:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322748288:0@lo:400:kworker.0 00000100:00100000:2.0:1789264181.260439:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322748800:0@lo:400:kworker.0 00010000:00080000:2.0:1789264181.260452:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398374f100 x1876179322749184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264181.260456:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789264181.260467:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322749184:0@lo:400:kworker.0 00000100:00100000:0.0:1789264181.260469:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322749312:12345-0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789264181.260484:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836fea00 x1876179322747520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1789264181.260487:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264181.260525:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322749312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264181.260526:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322747520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789264181.260539:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789264181.260548:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322748160:0@lo:400:kworker.0 00010000:00080000:2.0:1789264181.260562:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3aa98a1c00 x1876179322748672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264181.260570:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322748672:0@lo:400:kworker.0 00010000:00080000:3.0:1789264181.260689:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836fd880 x1876179322749312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264181.260702:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322749312:0@lo:13:osp-pre-1-1.0 00000020:00000080:2.0:1789264181.412476:0:13150:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc2811fc0 20000000:00000080:2.0:1789264181.412499:0:13150:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c3983dd3000 uarg=0000000000000000 20000000:01000000:2.0:1789264181.412542:0:13150:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789264181.412548:0:13150:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789264181.412552:0:13150:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789264181.413196:0:13151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789264181.413346:0:13150:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789264181.421233:0:13150:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789264181.421267:0:13150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264181.421561:0:13150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6c80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9aa expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264181.421573:0:13150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3ac216c400/0xecaf9f2f14ed6c8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c87 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264181.421581:0:13150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed6c9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c95 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264181.421588:0:13150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36b200/0xecaf9f2f14ed6caa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6ca3 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264181.421594:0:13150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6cb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6cb1 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264181.421602:0:13150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed6ccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9e9 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264181.421610:0:13150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264181.421651:0:13150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed6ccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9e9 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264181.421679:0:13150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed6ccd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9e9 expref: 12 pid: 6485 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264181.421694:0:13150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1876179322749440:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264181.421927:0:13150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6cb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6cb1 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264181.421935:0:13150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6cb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6cb1 expref: 23 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264181.421944:0:13150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1876179322749568:0@lo:104: 00000100:00100000:2.0:1789264181.421984:0:13150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789264181.422642:0:13150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36b200/0xecaf9f2f14ed6caa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6ca3 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264181.422653:0:13150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8a36b200/0xecaf9f2f14ed6caa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6ca3 expref: 23 pid: 6484 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264181.422664:0:13150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836ff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1876179322749696:0@lo:104: 00000100:00100000:2.0:1789264181.422694:0:13150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789264181.424955:0:13150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed6c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6c95 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264181.424974:0:13150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed6c9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6c95 expref: 23 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264181.424988:0:13150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1876179322749824:0@lo:104: 00000100:00100000:2.0:1789264181.425038:0:13150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789264181.425074:0:13150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3ac216c400/0xecaf9f2f14ed6c8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6c87 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264181.425082:0:13150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3ac216c400/0xecaf9f2f14ed6c8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6c87 expref: 23 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264181.425090:0:13150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1876179322749952:0@lo:104: 00000100:00100000:2.0:1789264181.425112:0:13150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789264181.425133:0:13150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9aa expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264181.425142:0:13150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6c80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9aa expref: 12 pid: 6485 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264181.425151:0:13150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1876179322750080:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264181.425207:0:13150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a88feb840 going to sleep for 11 seconds 00000100:00100000:1.0:1789264181.425905:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322749568 00000100:00100000:1.0:1789264181.425914:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322749568 00000100:00100000:1.0:1789264181.425959:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322749696 00000100:00100000:1.0:1789264181.425962:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322749696 00000100:00100000:1.0:1789264181.425981:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322749824 00000100:00100000:1.0:1789264181.425984:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322749824 00000100:00100000:1.0:1789264181.426000:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322749952 00000100:00100000:1.0:1789264181.426003:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322749952 00000100:00100000:1.0:1789264181.426024:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789264181.426035:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+6:13150:x1876179322749568:12345-0@lo:104: 00010000:00010000:1.0:1789264181.426060:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426145:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789264181.426152:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+6:13150:x1876179322749568:12345-0@lo:104: Request processed in 120us (4167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264181.426161:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789264181.426188:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789264181.426197:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:13150:x1876179322749696:12345-0@lo:104: 00010000:00010000:1.0:1789264181.426205:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6caa expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426247:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789264181.426253:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:13150:x1876179322749696:12345-0@lo:104: Request processed in 58us (3559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264181.426260:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789264181.426291:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789264181.426313:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:13150:x1876179322749824:12345-0@lo:104: 00010000:00010000:1.0:1789264181.426322:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6c9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426365:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789264181.426371:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:13150:x1876179322749824:12345-0@lo:104: Request processed in 74us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264181.426380:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789264181.426404:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789264181.426413:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:13150:x1876179322749952:12345-0@lo:104: 00010000:00010000:1.0:1789264181.426421:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426453:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789264181.426459:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:13150:x1876179322749952:12345-0@lo:104: Request processed in 49us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264181.426467:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789264181.426489:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789264181.426495:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426503:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36be00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264181.426508:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426517:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264181.426535:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264181.426541:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789264181.426578:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426584:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264181.426606:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426613:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6cb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426629:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789264181.426633:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6caa expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426639:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36ac00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264181.426642:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6caa expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426649:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6caa expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264181.426655:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6caa expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264181.426661:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789264181.426685:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6caa expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426691:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264181.426700:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6caa expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426706:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ca3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6caa expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426717:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789264181.426720:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6c9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426726:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264181.426729:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6c9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.426735:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6c9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264181.426934:0:13150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1876179322749568:0@lo:104: 00000100:00100000:0.0:1789264181.426948:0:13150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836ff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1876179322749696:0@lo:104: 00000100:00100000:0.0:1789264181.426958:0:13150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1876179322749824:0@lo:104: 00000100:00100000:0.0:1789264181.426966:0:13150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1876179322749952:0@lo:104: 10000000:00010000:1.0:1789264181.426999:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6c9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264181.427007:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789264181.427024:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6c9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.427029:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264181.427100:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6c9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.427118:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622600/0xecaf9f2f14ed6c95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6c9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.427131:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264181.427135:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.427141:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623c00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264181.427144:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.427152:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264181.427159:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264181.427164:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789264181.427179:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264181.427184:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264181.427187:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264181.427192:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264181.427201:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.427209:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5623c00/0xecaf9f2f14ed6c87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264181.427231:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322750336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264181.427279:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264181.427336:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789264181.427344:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322750208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264181.427373:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789264181.427413:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264181.427414:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322750336 00010000:00010000:1.0:1789264181.427422:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264181.427425:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264181.427438:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322750592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264181.427468:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264181.427494:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789264181.427500:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322750464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264181.427522:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264181.427553:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322750208 00000100:00100000:1.0:1789264181.427558:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322750208 00010000:00010000:1.0:1789264181.427581:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6cb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6cb1 expref: 24 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264181.427608:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322750592 00000100:00100000:1.0:1789264181.427611:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322750592 00010000:00010000:1.0:1789264181.427623:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3ac216c400/0xecaf9f2f14ed6c8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6c87 expref: 25 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264181.427638:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322750464 00000100:00100000:1.0:1789264181.427640:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322750464 00010000:00010000:1.0:1789264181.427650:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed6c9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6c95 expref: 26 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264181.427666:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789264181.427675:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+26:3625:x1876179322750208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789264181.427685:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264181.427690:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6cb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6cb1 expref: 26 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.427698:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6cb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6cb1 expref: 26 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.427723:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed6cb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6cb1 expref: 26 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.427736:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264181.428505:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322750336 00010000:00010000:0.0:1789264181.428533:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36b200/0xecaf9f2f14ed6caa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6ca3 expref: 26 pid: 6484 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264181.428563:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789264181.428574:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+26:3623:x1876179322750592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264181.428583:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264181.428589:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3ac216c400/0xecaf9f2f14ed6c8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6c87 expref: 26 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264181.428600:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3ac216c400/0xecaf9f2f14ed6c8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6c87 expref: 26 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264181.428616:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ac216c400/0xecaf9f2f14ed6c8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6c87 expref: 26 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264181.428631:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264181.428686:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+25:3623:x1876179322750592:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264181.428695:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789264181.428724:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789264181.428727:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3625:x1876179322750208:12345-0@lo:103:ldlm_bl.0 Request processed in 1049us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264181.428738:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789264181.428766:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3623:x1876179322750464:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264181.428776:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789264181.428787:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:3625:x1876179322750336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264181.428789:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264181.428797:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed6c9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6c95 expref: 23 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.428799:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264181.428809:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36b200/0xecaf9f2f14ed6caa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6ca3 expref: 23 pid: 6484 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264181.428812:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed6c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6c95 expref: 23 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264181.428839:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36a600/0xecaf9f2f14ed6c9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6c95 expref: 23 pid: 6485 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.428841:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36b200/0xecaf9f2f14ed6caa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6ca3 expref: 23 pid: 6484 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.430213:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36b200/0xecaf9f2f14ed6caa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6ca3 expref: 22 pid: 6484 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264181.430229:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264181.430253:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264181.430280:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:3625:x1876179322750336:12345-0@lo:103:ldlm_bl.0 Request processed in 1494us (3002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264181.430287:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789264181.430297:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:3623:x1876179322750464:12345-0@lo:103:ldlm_bl.0 Request processed in 1564us (2774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264181.430305:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789264181.430352:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322750464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264181.430372:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322750592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264181.430380:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322750208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264181.430395:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322750336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264181.430951:0:13150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1876179322749440:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264181.430960:0:13150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1876179322750080:192.168.203.44@tcp:104: 00010000:00010000:0.0:1789264181.430988:0:13150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264181.431718:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264181.431783:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264181.431936:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311148416 00000100:00100000:3.0:1789264181.431941:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311148288 00000100:00100000:0.0:1789264181.431944:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311148416 00000100:00100000:3.0:1789264181.431947:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311148288 00010000:00010000:3.0:1789264181.431977:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed6ccd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9e9 expref: 14 pid: 6485 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264181.431978:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6c80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9aa expref: 14 pid: 6485 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264181.432023:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:3.0:1789264181.432034:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2785450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+14:2403:x1876179311148288:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264181.432047:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264181.432053:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed6ccd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9e9 expref: 14 pid: 6485 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432064:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed6ccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9e9 expref: 14 pid: 6485 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432080:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed6ccd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9e9 expref: 14 pid: 6485 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432169:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264181.432467:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2785450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2403:x1876179311148288:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 433us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264181.432475:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:3.0:1789264181.432494:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:3.0:1789264181.432504:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:2403:x1876179311148416:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264181.432521:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264181.432527:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6c80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9aa expref: 12 pid: 6485 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432538:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9aa expref: 12 pid: 6485 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432568:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6c80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9aa expref: 12 pid: 6485 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432581:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432590:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432606:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432614:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432621:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432627:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432632:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623200 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264181.432636:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432666:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432686:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264181.432698:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264181.432727:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:2403:x1876179311148416:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 226us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264181.432734:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 45 00010000:00010000:0.0:1789264181.432838:0:13150:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264181.432859:0:13150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264181.432866:0:13150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5623200/0xecaf9f2f14ed6cf0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264181.770764:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789264181.770787:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322750720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789264181.770868:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264181.771161:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322750720 00000100:00100000:0.0:1789264181.771170:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322750720 00000100:00100000:0.0:1789264181.771230:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789264181.771240:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322750720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789264181.771272:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789264181.771328:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322750720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264181.771337:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789264181.771829:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322750720:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789264181.898025:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264182.221478:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264182.221519:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264182.221552:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264182.221573:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264182.221597:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264182.221622:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311148800 00000100:00100000:2.0:1789264182.221632:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311148800 00000100:00100000:2.0:1789264182.221686:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311149056 00000100:00100000:2.0:1789264182.221690:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311149056 00000100:00100000:2.0:1789264182.221711:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311148672 00000100:00100000:2.0:1789264182.221713:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311148672 00000100:00100000:2.0:1789264182.221726:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311148928 00000100:00100000:2.0:1789264182.221728:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311148928 00000100:00100000:2.0:1789264182.221769:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 124 00000100:00100000:2.0:1789264182.221780:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311148800:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264182.221880:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311148800:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 101us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264182.221890:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 124 00000100:00100000:2.0:1789264182.221914:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 125 00000100:00100000:2.0:1789264182.221923:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311149056:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264182.221949:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311149056:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264182.221957:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 125 00000100:00100000:2.0:1789264182.221975:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 126 00000100:00100000:2.0:1789264182.221983:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2405:x1876179311148672:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264182.222009:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2405:x1876179311148672:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 27us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264182.222016:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 126 00000100:00100000:2.0:1789264182.222031:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 127 00000100:00100000:2.0:1789264182.222038:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311148928:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264182.222063:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311148928:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 25us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264182.222069:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 127 00000100:00080000:0.0:1789264182.222082:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789264182.222087:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789264182.223645:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311148544 00000100:00100000:3.0:1789264182.223656:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311148544 00000100:00100000:3.0:1789264182.223722:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 297 00000100:00100000:3.0:1789264182.223734:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:2405:x1876179311148544:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264182.223822:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:2405:x1876179311148544:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 81us (2342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264182.223829:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 297 00000100:00100000:3.0:1789264182.237961:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264182.237995:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264182.238015:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311149184 00000100:00100000:0.0:1789264182.238034:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311149184 00000100:00080000:3.0:1789264182.238116:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264182.238149:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311149312 00000100:00100000:1.0:1789264182.238154:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311149312 00000100:00100000:0.0:1789264182.238221:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:0.0:1789264182.238232:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2401:x1876179311149184:12345-192.168.203.44@tcp:9:kworker.0 00000020:00000080:0.0:1789264182.238266:0:11052:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6ce2 00000100:00080000:0.0:1789264182.238275:0:11052:0:(import.c:65:import_set_state_nolock()) ffff9c3abf636800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789264182.238316:0:11052:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789264182.238332:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:1.0:1789264182.238343:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2401:x1876179311149312:12345-192.168.203.44@tcp:9:kworker.0 00000020:00000080:1.0:1789264182.238357:0:8403:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6ce9 00000100:00080000:1.0:1789264182.238363:0:8403:0:(import.c:65:import_set_state_nolock()) ffff9c3983122800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789264182.238399:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789264182.238475:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+2:2401:x1876179311149184:12345-192.168.203.44@tcp:9:kworker.0 Request processed in 245us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264182.238483:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:1.0:1789264182.238491:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+2:2401:x1876179311149312:12345-192.168.203.44@tcp:9:kworker.0 Request processed in 150us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264182.238502:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 23 00010000:00010000:0.0:1789264182.238517:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264182.238526:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789264182.238538:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:0.0:1789264182.793803:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789264182.793822:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3ab7f50000 from 7 10000000:01000000:0.0:1789264182.793830:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789264182.793874:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264182.793885:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264182.793902:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264182.793928:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322750848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789264182.794392:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264182.794442:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789264182.795073:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322750848 00000100:00100000:3.0:1789264182.795082:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322750848 00000100:00100000:3.0:1789264182.795173:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789264182.795184:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322750848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264182.795197:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264182.795212:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6cfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6cf7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264182.795247:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6cf7 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264182.795256:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6cf7 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264182.795265:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36aa00, rc 0) 00000100:00100000:3.0:1789264182.795325:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322750848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264182.795331:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1789264182.795490:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322750848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264182.795506:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6cfe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264182.795514:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6cfe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264182.795578:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322750976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264182.795605:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264182.795622:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789264182.797562:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322750976 00000100:00100000:3.0:1789264182.797574:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322750976 00000100:00100000:3.0:1789264182.797625:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789264182.797635:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322750976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264182.797898:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322750976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264182.797906:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789264182.798061:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322750976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789264182.798112:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322751104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789264182.798158:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264182.798196:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264182.798254:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322751104 00000100:00100000:2.0:1789264182.798260:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322751104 00000100:00100000:2.0:1789264182.798362:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789264182.798370:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322751104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789264182.798454:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322751104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264182.798590:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322751104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789264182.798879:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000040:00080000:2.0:1789264182.799951:0:13239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789264182.800166:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789264182.800192:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789264182.800202:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6cfe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264182.800212:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6cfe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264182.800233:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789264182.800236:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3aba913000 from 7 10000000:01000000:3.0:1789264182.800239:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789264182.800271:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264182.800347:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264182.800359:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264182.800382:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322751232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789264182.800437:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264182.800547:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322751232 00000100:00100000:2.0:1789264182.800554:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322751232 00000100:00100000:2.0:1789264182.800639:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789264182.800658:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322751232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789264182.800669:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264182.800681:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed6d0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6d05 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264182.800701:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed6d0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6d05 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264182.800711:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed6d0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6d05 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264182.800718:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622e00, rc 0) 00000100:00100000:3.0:1789264182.800780:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc600 going to sleep for 11 seconds 00000100:00100000:2.0:1789264182.801050:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322751232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 392us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264182.801057:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789264182.801117:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322751232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264182.801130:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6d0c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264182.801139:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6d0c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264182.801192:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322751360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264182.801220:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264182.801270:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc600 going to sleep for 11 seconds 00000100:00100000:2.0:1789264182.801366:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322751360 00000100:00100000:2.0:1789264182.801371:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322751360 00000100:00100000:2.0:1789264182.801432:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789264182.801439:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322751360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789264182.801732:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322751360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264182.801740:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789264182.801937:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322751360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264182.802038:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322751488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264182.802080:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264182.802137:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc600 going to sleep for 11 seconds 00000100:00100000:2.0:1789264182.802165:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322751488 00000100:00100000:2.0:1789264182.802170:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322751488 00000100:00100000:2.0:1789264182.802234:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789264182.802242:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322751488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789264182.802337:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322751488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264182.802343:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789264182.802401:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322751488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789264182.803092:0:13240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789264182.803141:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789264182.803158:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789264182.803167:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6d0c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264182.803176:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6d0c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264182.803186:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789264182.803188:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3aae2b1800 from 7 10000000:01000000:3.0:1789264182.803191:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789264182.803217:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264182.803225:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264182.803233:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264182.803246:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322751616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789264182.803280:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264182.804872:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789264182.805039:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322751616 00000100:00100000:1.0:1789264182.805048:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322751616 00000100:00100000:1.0:1789264182.805092:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789264182.805100:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322751616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789264182.805112:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264182.805127:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a813fd400/0xecaf9f2f14ed6d1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6d13 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264182.805166:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a813fd400/0xecaf9f2f14ed6d1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6d13 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264182.805176:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a813fd400/0xecaf9f2f14ed6d1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6d13 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264182.805184:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a813fd400, rc 0) 00000100:00100000:1.0:1789264182.805290:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322751616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264182.805297:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789264182.805449:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322751616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264182.805940:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6d1a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264182.806028:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6d1a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264182.806101:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322751744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264182.806139:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264182.806211:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789264182.806246:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322751744 00000100:00100000:1.0:1789264182.806251:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322751744 00000100:00100000:1.0:1789264182.806381:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789264182.806391:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322751744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789264182.806619:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322751744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264182.806627:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789264182.806819:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322751744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264182.806846:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322751872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264182.806886:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264182.806940:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789264182.807041:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322751872 00000100:00100000:1.0:1789264182.807046:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322751872 00000100:00100000:1.0:1789264182.807075:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789264182.807082:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322751872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789264182.807163:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322751872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264182.807169:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789264182.807246:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322751872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789264182.808922:0:13241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789264182.809150:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789264182.809171:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789264182.809182:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6d1a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264182.809193:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6d1a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264182.809203:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789264182.809205:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3a89eb9800 from 7 10000000:01000000:2.0:1789264182.809208:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789264182.809240:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264182.809248:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264182.809259:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264182.809357:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322752000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789264182.809414:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264182.809561:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5840 going to sleep for 11 seconds 00000100:00100000:1.0:1789264182.809607:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322752000 00000100:00100000:1.0:1789264182.809613:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322752000 00000100:00100000:1.0:1789264182.809777:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789264182.809786:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322752000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789264182.809799:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264182.809821:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a813fc800/0xecaf9f2f14ed6d28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6d21 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264182.809844:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a813fc800/0xecaf9f2f14ed6d28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6d21 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264182.809854:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a813fc800/0xecaf9f2f14ed6d28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6d21 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264182.809862:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a813fc800, rc 0) 00000100:00100000:1.0:1789264182.809900:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322752000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264182.809906:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789264182.809992:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322752000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789264182.810006:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264182.810015:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264182.810072:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322752128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789264182.810098:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264182.810246:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5840 going to sleep for 11 seconds 00000100:00100000:3.0:1789264182.810343:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322752128 00000100:00100000:3.0:1789264182.810349:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322752128 00000100:00100000:3.0:1789264182.810374:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789264182.810382:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322752128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264182.810557:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322752128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264182.810565:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789264182.810741:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322752128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789264182.810886:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322752256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789264182.810921:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264182.811036:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5840 going to sleep for 11 seconds 00000100:00100000:3.0:1789264182.811067:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322752256 00000100:00100000:3.0:1789264182.811072:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322752256 00000100:00100000:3.0:1789264182.811139:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789264182.811148:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322752256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264182.811246:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322752256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264182.811258:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789264182.811342:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322752256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789264182.812699:0:13242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789264182.812782:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789264182.812802:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789264182.812823:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264182.812834:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264182.922884:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264183.378265:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264183.378355:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311149440 00000100:00100000:3.0:1789264183.378365:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311149440 00000100:00100000:3.0:1789264183.378429:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 310 00000100:00100000:3.0:1789264183.378440:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:6166:x1876179311149440:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264183.378455:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264183.378473:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36b400/0xecaf9f2f14ed6d2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa1a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264183.378502:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36b400/0xecaf9f2f14ed6d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa1a expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264183.378514:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36b400/0xecaf9f2f14ed6d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa1a expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264183.378523:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b400, rc 0) 00000100:00100000:3.0:1789264183.378574:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:6166:x1876179311149440:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 137us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264183.378581:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 310 00000100:00100000:0.0:1789264183.380219:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264183.380303:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311149568 00000100:00100000:3.0:1789264183.380311:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311149568 00000100:00100000:3.0:1789264183.380359:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 311 00000100:00100000:3.0:1789264183.380370:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:6166:x1876179311149568:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264183.380487:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:6166:x1876179311149568:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 120us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264183.380494:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 311 00000100:00100000:3.0:1789264183.382466:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264183.382639:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311149696 00000100:00100000:0.0:1789264183.382870:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311149696 00000100:00100000:0.0:1789264183.382950:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 312 00000100:00100000:0.0:1789264183.382960:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:6166:x1876179311149696:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264183.383086:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:6166:x1876179311149696:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 Request processed in 127us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264183.383093:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 312 00000100:00100000:2.0:1789264183.388285:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264183.388391:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311149824 00000100:00100000:3.0:1789264183.388400:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311149824 00000100:00100000:3.0:1789264183.388452:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 313 00000100:00100000:3.0:1789264183.388462:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:6166:x1876179311149824:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264183.388476:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264183.388492:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed6d36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa21 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264183.388519:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed6d36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa21 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264183.388531:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed6d36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa21 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264183.388541:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b000, rc 0) 00000100:00100000:3.0:1789264183.388589:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:6166:x1876179311149824:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 129us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264183.388596:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 313 00000100:00100000:0.0:1789264183.389994:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264183.390153:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311149952 00000100:00100000:2.0:1789264183.390161:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311149952 00000100:00100000:2.0:1789264183.390208:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 314 00000100:00100000:2.0:1789264183.390218:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:6166:x1876179311149952:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789264183.390372:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:6166:x1876179311149952:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 155us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264183.390379:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 314 00000100:00100000:1.0:1789264183.394070:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264183.394105:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311150080 00000100:00100000:1.0:1789264183.394114:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311150080 00000100:00100000:1.0:1789264183.394161:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 315 00000100:00100000:1.0:1789264183.394170:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:6166:x1876179311150080:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789264183.394287:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:6166:x1876179311150080:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 Request processed in 117us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264183.394295:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 315 00000100:00100000:0.0:1789264183.817946:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789264183.817967:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322752384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789264183.818030:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264183.818103:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322752384 00000100:00100000:0.0:1789264183.818110:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322752384 00000100:00100000:0.0:1789264183.818171:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789264183.818181:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322752384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789264183.818207:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264183.818258:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322752384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264183.818265:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1789264183.818314:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264183.818325:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322752512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789264183.818352:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264183.818438:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322752512 00000100:00100000:3.0:1789264183.818443:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322752512 00000100:00100000:3.0:1789264183.818493:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789264183.818502:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322752512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789264183.818513:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264183.818543:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322752512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264183.818549:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1789264183.818811:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789264183.818837:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398374df80 x1876179322752512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264183.818855:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322752512:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789264183.819146:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3ababbfb80 x1876179322752384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264183.819159:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322752384:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789264183.948762:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789264184.095626:0:13349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789264184.330825:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789264184.330848:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322752640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789264184.330914:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264184.330959:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322752640 00000100:00100000:3.0:1789264184.330979:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322752640 00000100:00100000:3.0:1789264184.331051:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789264184.331061:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322752640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789264184.331095:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789264184.331989:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322752640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 926us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264184.331999:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789264184.332693:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322752640:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789264184.969970:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264185.994035:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264186.378909:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322752896:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.378969:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264186.379019:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1876179322753408:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379040:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264186.379062:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322753920:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379082:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264186.379107:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789264186.379112:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322752768:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379137:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264186.379157:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322753280:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379178:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264186.379195:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322753792:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379215:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264186.379232:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322754304:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379251:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264186.379281:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322753024:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379302:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264186.379316:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322753536:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379332:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264186.379346:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322754048:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379365:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264186.379384:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789264186.379389:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322753152:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379418:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264186.379430:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322753664:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379449:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264186.379466:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322754176:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379484:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264186.379513:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322752896 00000100:00100000:2.0:1789264186.379520:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322752896 00000100:00100000:2.0:1789264186.379555:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322753408 00000100:00100000:2.0:1789264186.379558:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322753408 00000100:00100000:2.0:1789264186.379578:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322753920 00000100:00100000:2.0:1789264186.379581:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322753920 00000100:00100000:2.0:1789264186.379595:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322753536 00000100:00100000:2.0:1789264186.379598:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322753536 00000100:00100000:2.0:1789264186.379609:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322754048 00000100:00100000:2.0:1789264186.379611:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322754048 00000100:00100000:2.0:1789264186.379622:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322753152 00000100:00100000:2.0:1789264186.379624:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322753152 00000100:00100000:2.0:1789264186.379638:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789264186.379646:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322752896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379688:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322752896:12345-0@lo:400:kworker.0 Request processed in 43us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264186.379701:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789264186.379717:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789264186.379723:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876179322753408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379771:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876179322753408:12345-0@lo:400:kworker.0 Request processed in 48us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264186.379777:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789264186.379801:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789264186.379808:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322753920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379835:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322753920:12345-0@lo:400:kworker.0 Request processed in 28us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264186.379840:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789264186.379852:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789264186.379858:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322753536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379888:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322753536:12345-0@lo:400:kworker.0 Request processed in 31us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264186.379894:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789264186.379905:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789264186.379910:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322754048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379947:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322754048:12345-0@lo:400:kworker.0 Request processed in 37us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264186.379954:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789264186.379966:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789264186.379972:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322753152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.379997:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322753152:12345-0@lo:400:kworker.0 Request processed in 25us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264186.380008:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789264186.380030:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322752768 00000100:00100000:2.0:1789264186.380033:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322752768 00000100:00100000:2.0:1789264186.380059:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789264186.380065:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3625:x1876179322752768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.380094:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3625:x1876179322752768:12345-0@lo:400:kworker.0 Request processed in 29us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264186.380100:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789264186.380125:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322753280 00000100:00100000:2.0:1789264186.380128:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322753280 00000100:00100000:2.0:1789264186.380152:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322753024 00000100:00100000:2.0:1789264186.380155:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322753024 00000100:00100000:2.0:1789264186.380168:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789264186.380174:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322753280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.380204:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322753280:12345-0@lo:400:kworker.0 Request processed in 30us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264186.380210:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789264186.380221:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789264186.380227:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322753024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.380251:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322753024:12345-0@lo:400:kworker.0 Request processed in 25us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264186.380256:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789264186.380274:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322753792 00000100:00100000:2.0:1789264186.380277:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322753792 00000100:00100000:2.0:1789264186.380299:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322754304 00000100:00100000:2.0:1789264186.380301:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322754304 00000100:00100000:2.0:1789264186.380313:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322753664 00000100:00100000:2.0:1789264186.380322:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322753664 00000100:00100000:2.0:1789264186.380337:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322754176 00000100:00100000:2.0:1789264186.380339:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322754176 00000100:00100000:2.0:1789264186.380353:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789264186.380360:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322753792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.380390:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322753792:12345-0@lo:400:kworker.0 Request processed in 31us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264186.380396:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789264186.380407:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789264186.380414:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322754304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.380438:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322754304:12345-0@lo:400:kworker.0 Request processed in 25us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264186.380443:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789264186.380453:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789264186.380459:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322753664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.380482:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322753664:12345-0@lo:400:kworker.0 Request processed in 24us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264186.380488:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789264186.380498:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789264186.380503:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322754176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.380526:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322754176:12345-0@lo:400:kworker.0 Request processed in 24us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264186.380531:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789264186.380581:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322752768:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.380594:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322753280:0@lo:400:kworker.0 00010000:00080000:2.0:1789264186.380617:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983da3100 x1876179322753792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264186.380627:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322753792:0@lo:400:kworker.0 00010000:00080000:2.0:1789264186.380637:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983da0000 x1876179322754304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264186.380645:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322754304:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.380657:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322752896:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.380667:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1876179322753408:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.380677:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322753920:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.380720:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322753152:0@lo:400:kworker.0 00010000:00080000:2.0:1789264186.380730:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983da0a80 x1876179322753664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264186.380738:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322753664:0@lo:400:kworker.0 00010000:00080000:2.0:1789264186.380771:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983da1500 x1876179322754176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264186.380779:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322754176:0@lo:400:kworker.0 00000100:00100000:2.0:1789264186.380803:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322753024:0@lo:400:kworker.0 00010000:00080000:2.0:1789264186.380813:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983da1880 x1876179322753536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264186.380820:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322753536:0@lo:400:kworker.0 00010000:00080000:2.0:1789264186.380840:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983da3b80 x1876179322754048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264186.380848:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322754048:0@lo:400:kworker.0 00000100:00080000:0.0:1789264186.381123:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789264186.381128:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789264186.381131:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789264186.381134:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789264186.381182:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789264186.381193:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322754432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264186.381230:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264186.381302:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322754432 00000100:00100000:0.0:1789264186.381307:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322754432 00000100:00100000:0.0:1789264186.381342:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789264186.381350:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322754432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789264186.381370:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264186.381411:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322754432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264186.381418:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1789264186.381446:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398374df80 x1876179322754432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264186.381460:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322754432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789264186.381649:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789264186.381979:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322754560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264186.382063:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264186.382123:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322754560 00000100:00100000:3.0:1789264186.382128:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322754560 00000100:00100000:3.0:1789264186.382161:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789264186.382169:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322754560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789264186.382179:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264186.382214:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322754560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264186.382220:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1789264186.382325:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3a8f348a80 x1876179322754560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264186.382338:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322754560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264186.890266:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322754688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789264186.890344:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264186.890401:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322754688 00000100:00100000:2.0:1789264186.890410:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322754688 00000100:00100000:2.0:1789264186.890493:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789264186.890505:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322754688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789264186.890543:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789264186.898838:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322754688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8324us (8482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264186.899015:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322754688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789264186.899444:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:1.0:1789264187.018553:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264187.341717:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264187.341798:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264187.341840:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264187.341938:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264187.341959:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264187.343377:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311150336 00000100:00100000:2.0:1789264187.343390:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311150336 00000100:00100000:2.0:1789264187.343464:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311150592 00000100:00100000:2.0:1789264187.343468:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311150592 00000100:00100000:2.0:1789264187.343490:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311150464 00000100:00100000:2.0:1789264187.343493:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311150464 00000100:00100000:2.0:1789264187.343504:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311150720 00000100:00100000:2.0:1789264187.343506:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311150720 00000100:00100000:2.0:1789264187.343525:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 134 00000100:00100000:2.0:1789264187.343535:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2405:x1876179311150336:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264187.343611:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2405:x1876179311150336:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 78us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264187.343619:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 134 00000100:00100000:2.0:1789264187.343635:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 135 00000100:00100000:2.0:1789264187.343643:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311150592:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264187.343687:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311150592:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 45us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264187.343693:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 135 00000100:00100000:2.0:1789264187.343706:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 136 00000100:00100000:2.0:1789264187.343713:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311150464:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264187.343738:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 137 00000100:00100000:3.0:1789264187.343789:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311150720:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264187.343819:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311150720:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 49us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264187.343825:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 137 00000100:00080000:1.0:1789264187.344276:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789264187.344280:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264187.344420:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311150464:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 707us (2481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264187.344428:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 136 00000100:00100000:0.0:1789264187.346203:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311150208 00000100:00100000:0.0:1789264187.346217:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311150208 00000100:00100000:0.0:1789264187.346339:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 317 00000100:00100000:0.0:1789264187.346350:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a86bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2405:x1876179311150208:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264187.346398:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a86bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2405:x1876179311150208:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 51us (4557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264187.346406:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 317 00000001:00100000:0.0:1789264187.403637:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7381f06c-fe63-4f19-bfe0-7d6bc17e625e 00000020:00000080:0.0:1789264187.403816:0:8398:0:(genops.c:885:class_export_put()) final put ffff9c3abf633000/7381f06c-fe63-4f19-bfe0-7d6bc17e625e 00000020:00000080:1.0:1789264187.405481:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3abf633000/7381f06c-fe63-4f19-bfe0-7d6bc17e625e for lustre-OST0000 00000020:00000080:1.0:1789264187.405540:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3abf636800 for lustre-OST0000 00000001:00100000:3.0:1789264187.410220:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7381f06c-fe63-4f19-bfe0-7d6bc17e625e 00000020:00000080:3.0:1789264187.410231:0:9482:0:(genops.c:885:class_export_put()) final put ffff9c3983126800/7381f06c-fe63-4f19-bfe0-7d6bc17e625e 00000020:00000080:1.0:1789264187.410497:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3983126800/7381f06c-fe63-4f19-bfe0-7d6bc17e625e for lustre-OST0001 00000020:00000080:1.0:1789264187.410544:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3983122800 for lustre-OST0001 00000001:02000400:1.0:1789264187.982042:0:13497:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:49:47 (1789264187) === 00010000:00010000:1.0:1789264188.042388:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264188.214312:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264188.216082:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311150848 00000100:00100000:0.0:1789264188.216153:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311150848 00000100:00100000:0.0:1789264188.216271:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:0.0:1789264188.216281:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:10474:x1876179311150848:12345-192.168.203.44@tcp:700:mkdir.0 00000100:00100000:0.0:1789264188.216430:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:10474:x1876179311150848:12345-192.168.203.44@tcp:700:mkdir.0 Request processed in 150us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264188.216438:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:1.0:1789264188.222527:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264188.223052:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311151104 00000100:00100000:3.0:1789264188.223076:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311151104 00000100:00100000:3.0:1789264188.223143:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:3.0:1789264188.223154:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:10474:x1876179311151104:12345-192.168.203.44@tcp:36:mkdir.0 00010000:00010000:3.0:1789264188.223207:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264188.223274:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8f094600/0xecaf9f2f14ed6bdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda995 expref: 6 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.223294:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3a916dc000) 00010000:00010000:3.0:1789264188.223303:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789264188.223384:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d3d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.223396:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.223405:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.223417:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6d44 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.223423:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6d44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.223429:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6d44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.224307:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6d4b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.224320:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6d4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.224333:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6d4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789264188.224349:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000814e5ce3 reply state 000000002a3b1449 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6d4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.224359:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6d4b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.224376:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983362600) 00010000:00010000:3.0:1789264188.224380:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789264188.224382:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789264188.224388:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789264188.224395:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.224402:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d3d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.224409:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.224415:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264188.224419:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.224427:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d3d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.224435:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983362300) 00010000:00010000:3.0:1789264188.224437:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264188.224446:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d3d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.224453:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d3d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789264188.224469:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000814e5ce3 reply state 000000002a3b1449 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6d44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.224478:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6d44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.224484:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c3983362800) 00010000:00010000:3.0:1789264188.224486:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789264188.224488:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789264188.224597:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+7:10474:x1876179311151104:12345-192.168.203.44@tcp:36:mkdir.0 Request processed in 1443us (2075us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789264188.224605:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:3.0:1789264188.241032:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.241122:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311151232 00000100:00100000:2.0:1789264188.241141:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311151232 00000100:00100000:2.0:1789264188.241274:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:2.0:1789264188.241287:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+7:10476:x1876179311151232:12345-192.168.203.44@tcp:101:chmod.0 00010000:00010000:2.0:1789264188.241309:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264188.241335:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6d52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa28 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.241409:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.241421:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.241433:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264188.241489:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789264188.241492:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264188.241554:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.241579:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6d52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa28 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.241596:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa28 expref: 8 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.241603:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e7c900) 00010000:00010000:2.0:1789264188.241606:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789264188.241609:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623400, rc 0) 00000100:00100000:2.0:1789264188.241671:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+8:10476:x1876179311151232:12345-192.168.203.44@tcp:101:chmod.0 Request processed in 388us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264188.241678:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:1.0:1789264188.246952:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.247656:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311151488 00000100:00100000:2.0:1789264188.247667:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311151488 00000100:00100000:2.0:1789264188.248095:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:2.0:1789264188.248110:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+8:10476:x1876179311151488:12345-192.168.203.44@tcp:36:chmod.0 00010000:00010000:2.0:1789264188.248168:0:9197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264188.248197:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa28 expref: 8 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.248217:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e7c900) 00010000:00010000:2.0:1789264188.248229:0:9197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789264188.248302:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6d60 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.248317:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6d60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.248343:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6d60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789264188.248532:0:9197:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3b0e514 reply state 000000001f67cac7 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6d60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.248545:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6d60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.248551:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e7c000) 00010000:00010000:2.0:1789264188.248554:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789264188.248556:0:9197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789264188.248564:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789264188.248842:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+9:10476:x1876179311151488:12345-192.168.203.44@tcp:36:chmod.0 Request processed in 735us (1896us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789264188.248859:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:3.0:1789264188.271032:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.271342:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311151616 00000100:00100000:2.0:1789264188.271352:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311151616 00000100:00100000:2.0:1789264188.271416:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:2.0:1789264188.271428:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+9:10477:x1876179311151616:12345-192.168.203.44@tcp:101:chown.0 00010000:00010000:2.0:1789264188.271450:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264188.271470:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa2f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.271531:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623000/0xecaf9f2f14ed6d6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.271545:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623000/0xecaf9f2f14ed6d6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.271567:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623000/0xecaf9f2f14ed6d6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264188.271607:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789264188.271611:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264188.271647:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623000/0xecaf9f2f14ed6d6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.271672:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa2f expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.271695:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623000/0xecaf9f2f14ed6d6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa2f expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.271704:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e7c000) 00010000:00010000:2.0:1789264188.271707:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789264188.271711:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623000, rc 0) 00000100:00100000:2.0:1789264188.271822:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+10:10477:x1876179311151616:12345-192.168.203.44@tcp:101:chown.0 Request processed in 397us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264188.271830:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:3.0:1789264188.275490:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.276297:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311151744 00000100:00100000:2.0:1789264188.276312:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311151744 00000100:00100000:2.0:1789264188.276382:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:2.0:1789264188.276393:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+10:10477:x1876179311151744:12345-192.168.203.44@tcp:101:chown.0 00010000:00010000:2.0:1789264188.276412:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264188.276431:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa36 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276519:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6d7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276533:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6d7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276543:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6d7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276553:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6d83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276560:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6d83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276566:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6d83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276635:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6d8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276644:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6d8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276650:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6d8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264188.276692:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789264188.276696:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264188.276712:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6d8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276735:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6d7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276741:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6d7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276784:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6d7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276789:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622c00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264188.276794:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6d7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276801:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6d7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276813:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e7c000) 00010000:00010000:2.0:1789264188.276816:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264188.276820:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6d7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276826:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6d7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276838:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6d83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276844:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6d83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276849:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6d83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276860:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622a00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264188.276863:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6d83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276869:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6d83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276877:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c3983362800) 00010000:00010000:2.0:1789264188.276880:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264188.276883:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6d83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276889:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6d83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276915:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa36 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276929:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6d8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa36 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.276936:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983362600) 00010000:00010000:2.0:1789264188.276938:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789264188.276941:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622200, rc 0) 00000100:00100000:2.0:1789264188.278202:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+11:10477:x1876179311151744:12345-192.168.203.44@tcp:101:chown.0 Request processed in 1805us (2719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264188.278212:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:1.0:1789264188.281238:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264188.281348:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311151872 00000100:00100000:0.0:1789264188.281530:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311151872 00000100:00100000:0.0:1789264188.281594:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:0.0:1789264188.281605:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:92638a4f-1391-4305-a4ab-5961bcacc46a+11:10477:x1876179311151872:12345-192.168.203.44@tcp:900:chown.0 00000100:00100000:0.0:1789264188.282078:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:92638a4f-1391-4305-a4ab-5961bcacc46a+11:10477:x1876179311151872:12345-192.168.203.44@tcp:900:chown.0 Request processed in 473us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264188.282087:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:3.0:1789264188.296826:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.297072:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311152128 00000100:00100000:2.0:1789264188.297094:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311152128 00000100:00100000:2.0:1789264188.297231:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:2.0:1789264188.297245:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+11:10477:x1876179311152128:12345-192.168.203.44@tcp:36:chown.0 00010000:00010000:2.0:1789264188.297315:0:9197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264188.297351:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6d8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa36 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.297385:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983362600) 00010000:00010000:2.0:1789264188.297391:0:9197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789264188.297423:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d91 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.297439:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.297451:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789264188.305450:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1789264188.306533:0:9197:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006771aafa reply state 00000000d8a5d608 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.306567:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.306578:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983362600) 00010000:00010000:2.0:1789264188.306581:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789264188.306587:0:9197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789264188.306605:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1789264188.306733:0:9197:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789264188.306802:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+9:10477:x1876179311152128:12345-192.168.203.44@tcp:36:chown.0 Request processed in 9555us (9985us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789264188.306839:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27 00010000:00010000:3.0:1789264188.307309:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.307321:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.307328:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.307335:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264188.307347:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.307356:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.307372:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983362600) 00010000:00010000:3.0:1789264188.307375:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789264188.307380:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d91 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.307387:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6d91 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.308979:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6d44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309000:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6d44 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309008:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6d44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309016:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264188.309021:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6d44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309030:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6d44 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309066:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c3983362800) 00010000:00010000:0.0:1789264188.309070:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264188.309075:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6d44 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309081:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6d44 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309111:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6d4b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309117:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6d4b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309122:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6d4b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309126:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264188.309129:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6d4b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309134:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6d4b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309141:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983362600) 00010000:00010000:0.0:1789264188.309143:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264188.309145:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6d4b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309151:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6d4b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309182:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6d60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309189:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6d60 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309194:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6d60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309200:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264188.309202:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6d60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309208:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6d60 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309217:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e7c000) 00010000:00010000:0.0:1789264188.309219:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789264188.309222:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6d60 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.309227:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6d60 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264188.334420:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.334576:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311152256 00000100:00100000:2.0:1789264188.334590:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311152256 00000100:00100000:2.0:1789264188.334671:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:2.0:1789264188.334685:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:10478:x1876179311152256:12345-192.168.203.44@tcp:101:touch.500 00010000:00010000:2.0:1789264188.334718:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264188.334997:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6d98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa3d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789264188.337002:0:6491:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1934us 00010000:00010000:3.0:1789264188.354948:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.354979:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.354994:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355014:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6da6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355021:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6da6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355028:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6da6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355199:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed6dad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355209:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed6dad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355216:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed6dad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264188.355251:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789264188.355255:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264188.355302:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed6dad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355316:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355323:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d9f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355331:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355338:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264188.355343:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355352:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355367:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e7c000) 00010000:00010000:3.0:1789264188.355377:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264188.355384:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355390:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6d9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355406:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6da6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355411:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6da6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355418:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6da6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355423:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264188.355426:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6da6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355446:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6da6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355455:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c3983361400) 00010000:00010000:3.0:1789264188.355458:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264188.355460:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6da6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355466:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6da6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355514:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6d98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa3d expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355546:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed6dad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa3d expref: 7 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.355554:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983361600) 00010000:00010000:3.0:1789264188.355557:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789264188.355560:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a800, rc 0) 00000100:00100000:3.0:1789264188.355655:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+7:10478:x1876179311152256:12345-192.168.203.44@tcp:101:touch.500 Request processed in 20972us (21248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264188.355665:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:1.0:1789264188.364018:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.364089:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311152512 00000100:00100000:2.0:1789264188.364104:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311152512 00000100:00100000:2.0:1789264188.364192:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:2.0:1789264188.364205:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+7:10478:x1876179311152512:12345-192.168.203.44@tcp:101:touch.500 00010000:00010000:2.0:1789264188.364232:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264188.364259:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6db4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa44 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.364405:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6dbb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.364434:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6dbb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.364449:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6dbb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.366167:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6dc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.366204:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.366217:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789264188.366602:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789264188.366800:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6dc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.366810:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.366818:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.366852:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6dbb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.366858:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6dbb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.366865:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6dbb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.366870:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622c00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264188.366875:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6dbb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.366882:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6dbb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.366920:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983361600) 00010000:00010000:2.0:1789264188.366923:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264188.366928:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6dbb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.366938:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6dbb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789264188.366951:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a9d3c81 reply state 00000000f4501802 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.366961:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6dc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.366967:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff9c3ab7e7c900) 00010000:00010000:2.0:1789264188.366969:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789264188.366972:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789264188.367004:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6db4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa44 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.367019:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa44 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.367026:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c3ab7e7c300) 00010000:00010000:2.0:1789264188.367028:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789264188.367030:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623600, rc 0) 00000100:00100000:2.0:1789264188.367102:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+10:10478:x1876179311152512:12345-192.168.203.44@tcp:101:touch.500 Request processed in 2900us (3105us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789264188.367111:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:3.0:1789264188.370824:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.371125:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311152768 00000100:00100000:2.0:1789264188.371134:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311152768 00000100:00100000:2.0:1789264188.371196:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:2.0:1789264188.371208:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+10:10478:x1876179311152768:12345-192.168.203.44@tcp:36:touch.500 00010000:00010000:2.0:1789264188.371265:0:9197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264188.371290:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6dc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa44 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.371309:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c3ab7e7c300) 00010000:00010000:2.0:1789264188.371320:0:9197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789264188.371369:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6dd7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.371382:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.371392:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789264188.371488:0:9197:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000849d8431 reply state 000000004e9c6ce1 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.371500:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6dd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.371506:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c3ab7e7c100) 00010000:00010000:2.0:1789264188.371508:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789264188.371511:0:9197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789264188.371597:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+11:10478:x1876179311152768:12345-192.168.203.44@tcp:36:touch.500 Request processed in 392us (781us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789264188.371620:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:3.0:1789264188.373130:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.373260:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311152896 00000100:00100000:2.0:1789264188.373268:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311152896 00000100:00100000:2.0:1789264188.373325:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:2.0:1789264188.373336:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+11:10478:x1876179311152896:12345-192.168.203.44@tcp:101:touch.500 00010000:00010000:2.0:1789264188.373353:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264188.373377:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6dde lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa4b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.373423:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6dde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa4b expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.373436:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6dde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa4b expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.373454:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c3ab7e7c100) 00010000:00010000:2.0:1789264188.373456:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789264188.373459:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622600, rc 0) 00000100:00100000:2.0:1789264188.373510:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+12:10478:x1876179311152896:12345-192.168.203.44@tcp:101:touch.500 Request processed in 177us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264188.373517:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:1.0:1789264188.376328:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.376443:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311153024 00000100:00100000:2.0:1789264188.376451:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311153024 00000100:00100000:2.0:1789264188.376497:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:2.0:1789264188.376504:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1876179311153024:12345-192.168.203.44@tcp:8:touch.500 00010000:00080000:2.0:1789264188.376534:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:2.0:1789264188.376587:0:8405:0:(genops.c:1385:class_connect()) connect: client 92638a4f-1391-4305-a4ab-5961bcacc46a, cookie 0xecaf9f2f14ed6de5 00002000:00100000:2.0:1789264188.376598:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 92638a4f-1391-4305-a4ab-5961bcacc46a/ffff9c3983e58800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789264188.376613:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789264188.376687:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789264188.376714:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9c3983e5f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789264188.376813:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2401:x1876179311153024:12345-192.168.203.44@tcp:8:touch.500 Request processed in 308us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264188.376820:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:3.0:1789264188.379189:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.379285:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311153152 00000100:00100000:2.0:1789264188.379294:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311153152 00000100:00100000:2.0:1789264188.379356:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00080000:1.0:1789264188.379467:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789264188.379496:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+6:0:x1876179311153152:12345-192.168.203.44@tcp:2:touch.500 00000001:00080000:1.0:1789264188.388306:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:1.0:1789264188.388328:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 92638a4f-1391-4305-a4ab-5961bcacc46a 00000100:00100000:2.0:1789264188.388714:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+5:0:x1876179311153152:12345-192.168.203.44@tcp:2:touch.500 Request processed in 9339us (9522us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789264188.388728:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:3.0:1789264188.395288:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.395897:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311153408 00000100:00100000:2.0:1789264188.395910:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311153408 00000100:00100000:2.0:1789264188.395994:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:2.0:1789264188.396008:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+12:10478:x1876179311153408:12345-192.168.203.44@tcp:35:touch.500 00000100:00100000:2.0:1789264188.397911:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+13:10478:x1876179311153408:12345-192.168.203.44@tcp:35:touch.500 Request processed in 381us (1113us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789264188.397934:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:1.0:1789264188.414827:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.415898:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311153536 00000100:00100000:2.0:1789264188.415915:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311153536 00000100:00100000:2.0:1789264188.416018:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 32 00000100:00100000:2.0:1789264188.416031:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+13:10479:x1876179311153536:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:2.0:1789264188.416090:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264188.416118:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6dec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa52 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.416215:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6df3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.416232:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.416245:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264188.416300:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789264188.416304:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264188.416348:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.416543:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6dec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa52 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.416566:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6df3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa52 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.416576:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983361600) 00010000:00010000:2.0:1789264188.416579:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789264188.416584:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622a00, rc 0) 00000100:00100000:2.0:1789264188.416672:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+14:10479:x1876179311153536:12345-192.168.203.44@tcp:101:rm.0 Request processed in 644us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264188.416680:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 32 00000100:00100000:3.0:1789264188.420146:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.420347:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311153792 00000100:00100000:2.0:1789264188.420359:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311153792 00000100:00100000:2.0:1789264188.420462:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:2.0:1789264188.420475:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+14:10479:x1876179311153792:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:2.0:1789264188.420501:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264188.420528:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6dfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa59 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264188.420659:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789264188.421159:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6dfa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa59 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.421179:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e7c000) 00010000:00010000:2.0:1789264188.421182:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789264188.421188:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6dfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa59 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.421209:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622c00, rc 0) 00000100:00100000:2.0:1789264188.421368:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+15:10479:x1876179311153792:12345-192.168.203.44@tcp:101:rm.0 Request processed in 895us (1237us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1789264188.421377:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:3.0:1789264188.430085:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264188.438258:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311153920 00000100:00100000:1.0:1789264188.438282:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311153920 00000100:00100000:1.0:1789264188.438372:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:1.0:1789264188.438384:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+15:10479:x1876179311153920:12345-192.168.203.44@tcp:37:rm.0 00000100:00100000:3.0:1789264188.444325:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+15:10479:x1876179311153920:12345-192.168.203.44@tcp:37:rm.0 Request processed in 5926us (14238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264188.444345:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:2.0:1789264188.448276:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264188.448426:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311154176 00000100:00100000:3.0:1789264188.448439:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311154176 00000100:00100000:3.0:1789264188.448527:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:3.0:1789264188.448675:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c44bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+15:10479:x1876179311154176:12345-192.168.203.44@tcp:35:rm.0 00000100:00100000:3.0:1789264188.449236:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c44bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+16:10479:x1876179311154176:12345-192.168.203.44@tcp:35:rm.0 Request processed in 690us (973us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789264188.449246:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:2.0:1789264188.453707:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264188.453930:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311154432 00000100:00100000:0.0:1789264188.453952:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311154432 00000100:00100000:0.0:1789264188.454138:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:0.0:1789264188.454152:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+16:10479:x1876179311154432:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1789264188.454184:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264188.454224:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed6e08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa60 expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.454397:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b800/0xecaf9f2f14ed6e0f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.454416:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b800/0xecaf9f2f14ed6e0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.454431:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b800/0xecaf9f2f14ed6e0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264188.454444:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789264188.454628:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed6e08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa60 expref: 19 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.454651:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b800/0xecaf9f2f14ed6e0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa60 expref: 18 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.454661:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983361600) 00010000:00010000:0.0:1789264188.454665:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789264188.454669:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366b800, rc 0) 00000100:00100000:0.0:1789264188.454821:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+18:10479:x1876179311154432:12345-192.168.203.44@tcp:101:rm.0 Request processed in 673us (1129us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789264188.454830:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:1.0:1789264188.464150:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.464357:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311154560 00000100:00100000:2.0:1789264188.464380:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311154560 00000100:00100000:2.0:1789264188.464469:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:2.0:1789264188.464483:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+18:10479:x1876179311154560:12345-192.168.203.44@tcp:41:rm.0 00000004:00000024:2.0:1789264188.464910:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1789264188.465173:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+18:10479:x1876179311154560:12345-192.168.203.44@tcp:41:rm.0 Request processed in 692us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264188.465182:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:3.0:1789264188.471362:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264188.471549:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311154688 00000100:00100000:2.0:1789264188.471564:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311154688 00000100:00100000:2.0:1789264188.471977:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:2.0:1789264188.471992:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+18:10479:x1876179311154688:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:2.0:1789264188.472021:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264188.472048:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6e1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa67 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472134:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623c00/0xecaf9f2f14ed6e24 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472152:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623c00/0xecaf9f2f14ed6e24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472165:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623c00/0xecaf9f2f14ed6e24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472180:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6e2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472188:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6e2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472196:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6e2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472324:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6e32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472334:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472341:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264188.472394:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789264188.472399:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264188.472421:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472437:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472447:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623c00/0xecaf9f2f14ed6e24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472454:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623c00/0xecaf9f2f14ed6e24 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472461:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623c00/0xecaf9f2f14ed6e24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472468:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623c00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264188.472474:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623c00/0xecaf9f2f14ed6e24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472482:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623c00/0xecaf9f2f14ed6e24 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472506:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983361600) 00010000:00010000:2.0:1789264188.472510:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264188.472514:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623c00/0xecaf9f2f14ed6e24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472521:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623c00/0xecaf9f2f14ed6e24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472537:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6e2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472543:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6e2b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472550:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6e2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472555:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264188.472557:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6e2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472563:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6e2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472570:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff9c3ab7e7c900) 00010000:00010000:2.0:1789264188.472572:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264188.472576:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6e2b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472593:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623600/0xecaf9f2f14ed6e2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472645:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6e1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa67 expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472661:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6e32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa67 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264188.472669:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c3ab7e7c100) 00010000:00010000:2.0:1789264188.472671:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789264188.472674:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622c00, rc 0) 00000100:00100000:2.0:1789264188.472794:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+19:10479:x1876179311154688:12345-192.168.203.44@tcp:101:rm.0 Request processed in 806us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264188.472801:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:3.0:1789264188.478873:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264188.479149:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311154944 00000100:00100000:0.0:1789264188.479162:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311154944 00000100:00100000:3.0:1789264188.479375:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 37 00000100:00100000:3.0:1789264188.479401:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+19:10479:x1876179311154944:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1789264188.479485:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789264188.479519:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6e32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa67 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.479546:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6dde lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa4b expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.479558:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c3ab7e7c100) 00010000:00010000:3.0:1789264188.479569:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6df3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa52 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.479578:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983361600) 00010000:00010000:3.0:1789264188.479582:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789264188.479611:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e39 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.479628:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.479640:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.479652:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6e40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.479682:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6e40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.479690:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6e40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.481503:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.481531:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.481544:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789264188.482088:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1789264188.482114:0:6490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 268823369621ns, next at 269823364202ns, rc = 0 00010000:00010000:3.0:1789264188.482203:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.482220:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.482233:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.482242:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e4e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.482248:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e4e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.482271:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e4e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.482312:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789264188.482333:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.482340:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e47 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.482348:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.482354:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264188.482359:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.482367:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e47 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.482381:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c3ab7e7c100) 00010000:00010000:3.0:1789264188.482384:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789264188.482386:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264188.482390:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e47 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.482399:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e4e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.482401:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e47 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.482427:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36be00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264188.482448:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.482450:0:7431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e4e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.482487:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e39 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.482489:0:7431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e4e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.482532:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c3ab7e7c100) 00010000:00010000:0.0:1789264188.482536:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789264188.482783:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e4e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.482791:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e4e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264188.482808:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264188.482810:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264188.482813:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264188.483579:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e39 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.483588:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36ac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264188.483593:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e39 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.483600:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e39 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.483614:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983361600) 00010000:00010000:3.0:1789264188.483617:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264188.483621:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e39 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.483628:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e39 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789264188.483643:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a62e18bb reply state 00000000ec26fdcb transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6e40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.483655:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6e40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.483661:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff9c3ab7e7c900) 00010000:00010000:3.0:1789264188.483663:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789264188.483666:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789264188.483800:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+18:10479:x1876179311154944:12345-192.168.203.44@tcp:36:rm.0 Request processed in 4409us (4939us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789264188.483809:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 37 00000100:00100000:1.0:1789264188.489701:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264188.489825:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311155200 00000100:00100000:3.0:1789264188.489836:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311155200 00000100:00100000:3.0:1789264188.490057:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:3.0:1789264188.490069:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+18:10479:x1876179311155200:12345-192.168.203.44@tcp:35:rm.0 00000100:00100000:3.0:1789264188.490426:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+19:10479:x1876179311155200:12345-192.168.203.44@tcp:35:rm.0 Request processed in 360us (733us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789264188.490434:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:2.0:1789264188.493847:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264188.494025:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311155456 00000100:00100000:3.0:1789264188.494036:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311155456 00000100:00100000:3.0:1789264188.494093:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 38 00000100:00100000:3.0:1789264188.494102:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+19:10479:x1876179311155456:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1789264188.494159:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789264188.494376:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b800/0xecaf9f2f14ed6e0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa60 expref: 19 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.494399:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed6dad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa3d expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.494409:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983361600) 00010000:00010000:3.0:1789264188.494424:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623000/0xecaf9f2f14ed6d6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa2f expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.494431:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e7c000) 00010000:00010000:3.0:1789264188.494437:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789264188.494459:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e55 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.494470:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.494494:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.494513:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e5c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.494669:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.494676:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.494872:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e63 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.494882:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.494889:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264188.495126:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789264188.495141:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495147:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e63 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495153:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e63 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495159:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36be00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264188.495171:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e63 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495194:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e63 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495204:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c3983361400) 00010000:00010000:3.0:1789264188.495207:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789264188.495211:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e63 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495217:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e63 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495238:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495244:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e55 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495249:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495254:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36ac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264188.495257:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495263:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e55 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495269:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983361000) 00010000:00010000:3.0:1789264188.495271:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264188.495281:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e55 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495298:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6e55 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789264188.495312:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0d307da reply state 0000000081063640 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495324:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264188.495330:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c3983361a00) 00010000:00010000:3.0:1789264188.495332:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789264188.495334:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789264188.495424:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+18:10479:x1876179311155456:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1321us (1585us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789264188.495432:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 38 00000100:00100000:1.0:1789264188.938043:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322754816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789264188.938115:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264188.938202:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789264188.938210:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322754944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789264188.938235:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264188.938325:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322754816 00000100:00100000:0.0:1789264188.938334:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322754816 00000100:00100000:0.0:1789264188.938392:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322754944 00000100:00100000:0.0:1789264188.938395:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322754944 00000100:00100000:0.0:1789264188.938417:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789264188.938426:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322754816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789264188.938456:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264188.938507:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322754816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264188.938514:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789264188.938532:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789264188.938539:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322754944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789264188.938548:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264188.938589:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322754944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264188.938595:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1789264188.938902:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789264188.938959:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c37100 x1876179322754944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264188.938979:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322754944:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789264188.938995:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398374f100 x1876179322754816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264188.939007:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322754816:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789264189.069047:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264189.452318:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322755072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789264189.452380:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264189.452447:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322755072 00000100:00100000:2.0:1789264189.452456:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322755072 00000100:00100000:2.0:1789264189.452529:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789264189.452542:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322755072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789264189.452573:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789264189.452627:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322755072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264189.452635:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789264189.452788:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322755072:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789264190.097641:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264191.114847:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264191.497960:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322755456:0@lo:400:kworker.0 00000100:00100000:2.0:1789264191.498041:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264191.498086:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322755968:0@lo:400:kworker.0 00000100:00100000:2.0:1789264191.498125:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264191.498147:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1876179322756480:0@lo:400:kworker.0 00000100:00100000:2.0:1789264191.498167:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264191.498186:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789264191.498192:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322755328:0@lo:400:kworker.0 00000100:00100000:2.0:1789264191.498212:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264191.498229:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1876179322755840:0@lo:400:kworker.0 00000100:00100000:2.0:1789264191.498248:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264191.498267:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322756352:0@lo:400:kworker.0 00000100:00100000:2.0:1789264191.498291:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264191.498331:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322755456 00000100:00100000:2.0:1789264191.498339:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322755456 00000004:00080000:1.0:1789264191.498349:0:10066:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 271839603206ns, next at 272839600601ns, rc = 0 00000100:00100000:0.0:1789264191.498464:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322755584:0@lo:400:kworker.0 00000100:00100000:0.0:1789264191.498504:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264191.498516:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789264191.498524:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322756096:0@lo:400:kworker.0 00000100:00100000:2.0:1789264191.498530:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322755456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264191.498555:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264191.498579:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322756608:0@lo:400:kworker.0 00000100:00100000:2.0:1789264191.498590:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322755456:12345-0@lo:400:kworker.0 Request processed in 64us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264191.498600:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789264191.498606:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264191.498626:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322755968 00000100:00100000:0.0:1789264191.498630:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789264191.498632:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322755968 00000100:00100000:0.0:1789264191.498640:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322755200:0@lo:400:kworker.0 00000100:00100000:0.0:1789264191.498672:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264191.498696:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322755712:0@lo:400:kworker.0 00000100:00100000:0.0:1789264191.498722:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264191.498740:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322756224:0@lo:400:kworker.0 00000100:00100000:0.0:1789264191.498802:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264191.498822:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322756736:0@lo:400:kworker.0 00000100:00100000:0.0:1789264191.498855:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264191.498883:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322756864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789264191.498923:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264191.498957:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322756480 00000100:00100000:0.0:1789264191.498963:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322756480 00000100:00100000:0.0:1789264191.498985:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322755328 00000100:00100000:0.0:1789264191.498988:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322755328 00000100:00100000:0.0:1789264191.498999:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322755840 00000100:00100000:0.0:1789264191.499001:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322755840 00000100:00100000:0.0:1789264191.499012:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322756352 00000100:00100000:0.0:1789264191.499015:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322756352 00000100:00100000:2.0:1789264191.499021:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322755584 00000100:00100000:2.0:1789264191.499027:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322755584 00000100:00100000:0.0:1789264191.499035:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789264191.499044:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322755968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264191.499056:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789264191.499067:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876179322756480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264191.499083:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322755968:12345-0@lo:400:kworker.0 Request processed in 40us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264191.499091:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789264191.499106:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789264191.499112:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876179322756480:12345-0@lo:400:kworker.0 Request processed in 47us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264191.499116:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322755328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264191.499125:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789264191.499150:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322755328:12345-0@lo:400:kworker.0 Request processed in 37us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264191.499156:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789264191.499258:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789264191.499274:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876179322755840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264191.499309:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876179322755840:12345-0@lo:400:kworker.0 Request processed in 44us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264191.499316:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789264191.501448:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789264191.501464:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322756352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264191.501532:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322756352:12345-0@lo:400:kworker.0 Request processed in 74us (3242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264191.501539:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789264191.501554:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789264191.501570:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322755584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264191.501609:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322755584:12345-0@lo:400:kworker.0 Request processed in 41us (3105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264191.501616:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789264191.501680:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322756096 00000100:00100000:0.0:1789264191.501686:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322756096 00000100:00100000:0.0:1789264191.501717:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322756608 00000100:00100000:0.0:1789264191.501719:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322756608 00000100:00100000:0.0:1789264191.501732:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322756224 00000100:00100000:0.0:1789264191.501735:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322756224 00000100:00100000:0.0:1789264191.501775:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322756736 00000100:00100000:0.0:1789264191.501778:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322756736 00000100:00100000:0.0:1789264191.501792:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789264191.501798:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322756096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264191.501829:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322756096:12345-0@lo:400:kworker.0 Request processed in 31us (3274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264191.501835:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789264191.501848:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789264191.501854:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322756608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264191.501883:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322756608:12345-0@lo:400:kworker.0 Request processed in 31us (3279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264191.501889:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789264191.501899:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789264191.501904:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322756224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264191.503052:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322756224:12345-0@lo:400:kworker.0 Request processed in 1143us (4245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264191.503062:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789264191.503105:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322755712 00000100:00100000:2.0:1789264191.503113:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322755712 00000100:00100000:2.0:1789264191.503232:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789264191.503245:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322755712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264191.503274:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789264191.503287:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322756736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264191.503290:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322756992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264191.503294:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322755712:12345-0@lo:400:kworker.0 Request processed in 52us (4569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264191.503303:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1789264191.503324:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789264191.503330:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789264191.503334:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789264191.503337:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789264191.503345:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264191.503350:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322756736:12345-0@lo:400:kworker.0 Request processed in 65us (4492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264191.503360:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789264191.503391:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322755200 00000100:00100000:1.0:1789264191.503397:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322755200 00000100:00100000:3.0:1789264191.503400:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322755328:0@lo:400:kworker.0 00000100:00100000:3.0:1789264191.503418:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1876179322755840:0@lo:400:kworker.0 00000100:00100000:3.0:1789264191.503435:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322756352:0@lo:400:kworker.0 00000100:00100000:1.0:1789264191.503437:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789264191.503447:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aaa0bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322755200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264191.503464:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322755456:0@lo:400:kworker.0 00010000:00080000:3.0:1789264191.503483:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c8b480 x1876179322755968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264191.503492:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aaa0bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322755200:12345-0@lo:400:kworker.0 Request processed in 45us (4816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264191.503498:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322755968:0@lo:400:kworker.0 00000100:00100000:1.0:1789264191.503505:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00080000:3.0:1789264191.503518:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c8b800 x1876179322756480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264191.503528:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1876179322756480:0@lo:400:kworker.0 00000100:00100000:3.0:1789264191.503587:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322756864 00000100:00100000:3.0:1789264191.503591:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322756864 00000100:00100000:3.0:1789264191.503623:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322756992 00000100:00100000:3.0:1789264191.503626:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322756992 00000100:00100000:3.0:1789264191.503642:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789264191.503649:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322756864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789264191.503670:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264191.503703:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322756864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (4780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264191.503709:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789264191.503723:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789264191.503730:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322756992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789264191.503804:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264191.503842:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322756992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264191.503849:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1789264191.503887:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abaa91f80 x1876179322756864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264191.504037:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322756864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789264191.504069:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322755200:0@lo:400:kworker.0 00000100:00100000:3.0:1789264191.504081:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322755712:0@lo:400:kworker.0 00010000:00080000:3.0:1789264191.504092:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c88a80 x1876179322756224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264191.504101:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322756224:0@lo:400:kworker.0 00010000:00080000:3.0:1789264191.504111:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c89500 x1876179322756736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264191.504120:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322756736:0@lo:400:kworker.0 00000100:00100000:3.0:1789264191.504132:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322755584:0@lo:400:kworker.0 00010000:00080000:3.0:1789264191.504143:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c89880 x1876179322756096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264191.504151:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322756096:0@lo:400:kworker.0 00010000:00080000:3.0:1789264191.504160:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c8bb80 x1876179322756608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264191.504167:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322756608:0@lo:400:kworker.0 00010000:00080000:3.0:1789264191.504198:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836fe680 x1876179322756992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264191.504208:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322756992:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1789264191.572161:0:13645:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1789264192.013412:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789264192.013433:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322757120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789264192.013497:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264192.013937:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322757120 00000100:00100000:0.0:1789264192.013945:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322757120 00000100:00100000:0.0:1789264192.013996:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789264192.014004:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322757120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789264192.014034:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789264192.014083:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322757120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264192.014090:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789264192.017887:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322757120:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789264192.137951:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264192.467685:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264192.467736:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264192.467804:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264192.467831:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264192.467852:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264192.467878:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264192.468032:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311155840 00000100:00100000:3.0:1789264192.468041:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311155840 00000100:00100000:3.0:1789264192.468094:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311156096 00000100:00100000:3.0:1789264192.468097:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311156096 00000100:00100000:3.0:1789264192.468109:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311155712 00000100:00100000:3.0:1789264192.468111:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311155712 00000100:00100000:3.0:1789264192.468133:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311156224 00000100:00100000:3.0:1789264192.468135:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311156224 00000100:00100000:3.0:1789264192.468151:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 144 00000100:00100000:3.0:1789264192.468160:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311155840:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264192.468233:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311155840:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 73us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264192.468239:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 144 00000100:00100000:3.0:1789264192.468256:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 145 00000100:00100000:3.0:1789264192.468264:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311156096:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264192.468288:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311156096:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264192.468293:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 145 00000100:00100000:3.0:1789264192.468303:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 146 00000100:00100000:3.0:1789264192.468310:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+18:2402:x1876179311155712:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264192.468336:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+18:2402:x1876179311155712:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 27us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264192.468343:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 146 00000100:00100000:3.0:1789264192.468354:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 147 00000100:00100000:3.0:1789264192.468361:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311156224:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264192.468397:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311156224:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 37us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264192.468403:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 147 00000100:00080000:3.0:1789264192.468419:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789264192.468424:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789264192.468859:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311155584 00000100:00100000:2.0:1789264192.468865:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311155584 00000100:00100000:2.0:1789264192.468902:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 319 00000100:00100000:2.0:1789264192.468920:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aaa0b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2402:x1876179311155584:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264192.468958:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aaa0b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2402:x1876179311155584:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 49us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264192.468964:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 319 00000100:00100000:0.0:1789264192.472682:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311155968 00000100:00100000:0.0:1789264192.472698:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311155968 00000100:00100000:0.0:1789264192.472932:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:0.0:1789264192.472943:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311155968:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264192.473023:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311155968:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 82us (5169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264192.473030:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 64 00000020:00000080:1.0:1789264192.474371:0:13693:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa75de7d0 20000000:00000080:1.0:1789264192.474387:0:13693:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c3983c6c400 uarg=0000000000000000 20000000:01000000:1.0:1789264192.474429:0:13693:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789264192.474435:0:13693:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789264192.474440:0:13693:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000100:00080000:3.0:1789264192.474637:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1789264192.475304:0:13694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789264192.475453:0:13693:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789264192.481658:0:13693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1789264192.481697:0:13693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1789264192.481712:0:13693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1789264192.481732:0:13693:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789264192.481954:0:13693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.481984:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6cf7 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.481993:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed6d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6d05 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.481999:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a813fd400/0xecaf9f2f14ed6d1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6d13 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.482005:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a813fc800/0xecaf9f2f14ed6d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6d21 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.482014:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36b400/0xecaf9f2f14ed6d2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa1a expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.482021:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed6d36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa21 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.482028:0:13693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.482074:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed6d36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa21 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.482089:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed6d36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa21 expref: 12 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264192.482104:0:13693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa92d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1876179322757248:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264192.482199:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36b400/0xecaf9f2f14ed6d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa1a expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.482213:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3a8a36b400/0xecaf9f2f14ed6d2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa1a expref: 12 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264192.482221:0:13693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1876179322757376:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264192.482247:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a813fc800/0xecaf9f2f14ed6d28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6d21 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.482255:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a813fc800/0xecaf9f2f14ed6d28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d21 expref: 23 pid: 6482 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264192.482263:0:13693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa93b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1876179322757504:0@lo:104: 00000100:00100000:1.0:1789264192.482301:0:13693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789264192.482348:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a813fd400/0xecaf9f2f14ed6d1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6d13 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.482357:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a813fd400/0xecaf9f2f14ed6d1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d13 expref: 23 pid: 6482 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264192.482365:0:13693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1876179322757632:0@lo:104: 00010000:00010000:1.0:1789264192.482389:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed6d0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6d05 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.482397:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed6d0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d05 expref: 23 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264192.482404:0:13693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa90380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1876179322757760:0@lo:104: 00010000:00010000:1.0:1789264192.482423:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed6cf7 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.482435:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6cfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6cf7 expref: 23 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264192.482443:0:13693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa90000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1876179322757888:0@lo:104: 00000100:00100000:1.0:1789264192.482459:0:13693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789264192.482587:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789264192.482605:0:6474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264192.482628:0:6474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264192.482637:0:6474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264192.482645:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322757504 00000100:00100000:2.0:1789264192.482651:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322757504 00000100:00100000:2.0:1789264192.482688:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322757632 00000100:00100000:2.0:1789264192.482691:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322757632 00000100:00100000:2.0:1789264192.482701:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322757760 00000100:00100000:2.0:1789264192.482704:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322757760 00000100:00100000:2.0:1789264192.482712:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322757888 00000100:00100000:2.0:1789264192.482721:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322757888 00000100:00100000:2.0:1789264192.482737:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789264192.482773:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad7a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+6:13693:x1876179322757504:12345-0@lo:104: 00010000:00010000:2.0:1789264192.482786:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.482837:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789264192.482843:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad7a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+6:13693:x1876179322757504:12345-0@lo:104: Request processed in 100us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264192.482850:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789264192.482885:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789264192.482892:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:13693:x1876179322757632:12345-0@lo:104: 00010000:00010000:2.0:1789264192.482898:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6d1a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.482932:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789264192.482936:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+5:13693:x1876179322757632:12345-0@lo:104: Request processed in 46us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264192.482942:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789264192.482954:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789264192.482961:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:13693:x1876179322757760:12345-0@lo:104: 00010000:00010000:2.0:1789264192.482967:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6d0c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.482995:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789264192.482999:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+4:13693:x1876179322757760:12345-0@lo:104: Request processed in 41us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264192.483005:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789264192.483021:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789264192.483028:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:13693:x1876179322757888:12345-0@lo:104: 00010000:00010000:2.0:1789264192.483036:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6cfe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483062:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789264192.483066:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+3:13693:x1876179322757888:12345-0@lo:104: Request processed in 40us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264192.483072:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1789264192.483088:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789264192.483094:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483101:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622400 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264192.483104:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483112:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264192.483119:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264192.483125:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789264192.483150:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483156:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789264192.483173:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483189:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6d21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483202:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789264192.483205:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6d1a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483211:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264192.483214:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6d1a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483220:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6d1a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264192.483226:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6d1a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264192.483231:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789264192.483245:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6d1a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483250:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789264192.483262:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6d1a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483268:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed6d13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6d1a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483275:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789264192.483283:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6d0c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483289:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36bc00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264192.483292:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6d0c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483298:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6d0c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264192.483304:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6d0c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264192.483309:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789264192.483321:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6d0c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483326:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789264192.483332:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6d0c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483337:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36bc00/0xecaf9f2f14ed6d05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6d0c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483345:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264192.483347:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed6cfe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483352:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366bc00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264192.483355:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed6cfe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483370:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed6cfe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264192.483376:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed6cfe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264192.483381:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789264192.483392:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6cfe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483398:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789264192.483403:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6cfe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483409:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c398366bc00/0xecaf9f2f14ed6cf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed6cfe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264192.483421:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264192.483423:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264192.483425:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264192.483431:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264192.483454:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264192.483678:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322758016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789264192.483712:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264192.483772:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789264192.483778:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322758400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789264192.483800:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264192.483827:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322758144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789264192.483847:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264192.483862:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789264192.483868:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322758272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789264192.483885:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264192.483915:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322758016 00000100:00100000:3.0:1789264192.483920:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322758016 00010000:00010000:3.0:1789264192.483946:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a813fc800/0xecaf9f2f14ed6d28 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d21 expref: 24 pid: 6482 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264192.483967:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322758400 00000100:00100000:3.0:1789264192.483970:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322758400 00010000:00010000:3.0:1789264192.483982:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6cfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6cf7 expref: 25 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264192.483993:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322758144 00000100:00100000:3.0:1789264192.483996:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322758144 00010000:00010000:3.0:1789264192.484015:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a813fd400/0xecaf9f2f14ed6d1a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d13 expref: 26 pid: 6482 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264192.484026:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322758272 00000100:00100000:3.0:1789264192.484029:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322758272 00010000:00010000:3.0:1789264192.484039:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed6d0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d05 expref: 27 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264192.484051:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789264192.484058:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+27:3623:x1876179322758016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789264192.484069:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264192.484076:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a813fc800/0xecaf9f2f14ed6d28 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d21 expref: 27 pid: 6482 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.484084:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a813fc800/0xecaf9f2f14ed6d28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d21 expref: 27 pid: 6482 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.484101:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264192.484128:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+27:3623:x1876179322758016:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264192.484134:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789264192.484147:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789264192.484154:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+26:3623:x1876179322758400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789264192.484160:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264192.484164:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6cfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6cf7 expref: 26 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.484172:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6cfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6cf7 expref: 26 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.484191:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264192.484214:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+26:3623:x1876179322758400:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264192.484219:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789264192.484232:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789264192.484238:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+25:3624:x1876179322758144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789264192.484244:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264192.484248:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a813fd400/0xecaf9f2f14ed6d1a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d13 expref: 25 pid: 6482 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.484255:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a813fd400/0xecaf9f2f14ed6d1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d13 expref: 25 pid: 6482 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.484264:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264192.484288:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+25:3624:x1876179322758144:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264192.484294:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789264192.484306:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789264192.484312:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322758272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789264192.484319:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264192.484323:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed6d0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d05 expref: 24 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.484330:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed6d0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d05 expref: 24 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.484355:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264192.484385:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322758272:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264192.484391:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789264192.484436:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322758272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789264192.484444:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322758144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789264192.484660:0:13693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a813fc800/0xecaf9f2f14ed6d28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d21 expref: 23 pid: 6482 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264192.484673:0:13693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa93b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1876179322757504:0@lo:104: 00010000:00010000:1.0:1789264192.484683:0:13693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a813fd400/0xecaf9f2f14ed6d1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d13 expref: 22 pid: 6482 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264192.484692:0:13693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1876179322757632:0@lo:104: 00010000:00010000:1.0:1789264192.484701:0:13693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5622e00/0xecaf9f2f14ed6d0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6d05 expref: 21 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264192.484708:0:13693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa90380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1876179322757760:0@lo:104: 00010000:00010000:1.0:1789264192.484716:0:13693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed6cfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed6cf7 expref: 20 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264192.484723:0:13693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa90000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1876179322757888:0@lo:104: 00000100:00100000:2.0:1789264192.484857:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322758400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789264192.484865:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322758016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789264192.488112:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264192.488188:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264192.488218:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311156480 00000100:00100000:3.0:1789264192.488226:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311156480 00010000:00010000:3.0:1789264192.488264:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36b400/0xecaf9f2f14ed6d2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa1a expref: 13 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264192.488290:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311156352 00000100:00100000:3.0:1789264192.488293:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311156352 00010000:00010000:3.0:1789264192.488305:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed6d36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa21 expref: 14 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264192.488324:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:3.0:1789264192.488334:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+14:2403:x1876179311156480:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264192.488353:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264192.488358:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36b400/0xecaf9f2f14ed6d2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa1a expref: 14 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.488369:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36b400/0xecaf9f2f14ed6d2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa1a expref: 14 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.488388:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264192.488433:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+14:2403:x1876179311156480:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 101us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264192.488451:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:3.0:1789264192.488467:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:3.0:1789264192.488474:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2403:x1876179311156352:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264192.488481:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264192.488485:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed6d36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa21 expref: 13 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.488494:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed6d36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa21 expref: 13 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.488506:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.488583:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.488599:0:8420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.488605:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.488612:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.488619:0:8420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.488626:0:8420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45e00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264192.488637:0:8420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.488645:0:8420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.488654:0:8420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264192.488665:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264192.488685:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2403:x1876179311156352:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 212us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264192.488692:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 51 00010000:00010000:1.0:1789264192.491470:0:13693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed6d36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa21 expref: 12 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264192.491490:0:13693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa92d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1876179322757248:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264192.491504:0:13693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36b400/0xecaf9f2f14ed6d2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa1a expref: 11 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264192.491532:0:13693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1876179322757376:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264192.491568:0:13693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.491578:0:13693:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.491583:0:13693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264192.491588:0:13693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed6e6a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789264193.076059:0:13742:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd956b7860 20000000:00000080:0.0:1789264193.076075:0:13742:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c3983e48400 uarg=0000000000000000 20000000:01000000:0.0:1789264193.076115:0:13742:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789264193.076121:0:13742:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789264193.076127:0:13742:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1789264193.076629:0:13743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1789264193.076854:0:13742:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1789264193.076920:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1789264193.076951:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1789264193.076970:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1789264193.076983:0:13742:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789264193.077002:0:13742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e71 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264193.077017:0:13742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e71 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264193.077027:0:13742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e71 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264193.077034:0:13742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e71 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264193.077041:0:13742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e71 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264193.077048:0:13742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e71 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264193.077055:0:13742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366aa00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:0.0:1789264193.077059:0:13742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e71 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264193.077067:0:13742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e71 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264193.077078:0:13742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e71 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264193.077098:0:13742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e71 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264193.077104:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e71 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264193.166825:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264193.742159:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264193.742310:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311156608 00000100:00100000:0.0:1789264193.742321:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311156608 00000100:00100000:0.0:1789264193.742385:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 320 00000100:00100000:0.0:1789264193.742396:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:6166:x1876179311156608:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264193.742411:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264193.742429:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa6e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264193.742453:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa6e expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264193.742464:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa6e expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264193.742472:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366aa00, rc 0) 00000100:00100000:0.0:1789264193.742528:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:6166:x1876179311156608:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 133us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264193.742534:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 320 00000100:00100000:3.0:1789264193.744294:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264193.744385:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311156736 00000100:00100000:1.0:1789264193.744396:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311156736 00000100:00100000:1.0:1789264193.744447:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 321 00000100:00100000:1.0:1789264193.744457:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:6166:x1876179311156736:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789264193.744610:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:6166:x1876179311156736:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 144us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264193.744619:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 321 00000100:00100000:3.0:1789264193.749346:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264193.749793:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311156864 00000100:00100000:2.0:1789264193.749804:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311156864 00000100:00100000:2.0:1789264193.749881:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 322 00000100:00100000:2.0:1789264193.749892:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:6166:x1876179311156864:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789264193.750026:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:6166:x1876179311156864:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 Request processed in 135us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264193.750034:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 322 00000100:00100000:3.0:1789264193.755102:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264193.755209:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311156992 00000100:00100000:0.0:1789264193.755219:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311156992 00000100:00100000:0.0:1789264193.755274:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 323 00000100:00100000:0.0:1789264193.755284:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:10763:x1876179311156992:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789264193.755448:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:10763:x1876179311156992:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 164us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264193.755456:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 323 00000100:00100000:3.0:1789264193.759717:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264193.759853:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311157120 00000100:00100000:1.0:1789264193.759867:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311157120 00000100:00100000:1.0:1789264193.759933:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 324 00000100:00100000:1.0:1789264193.759942:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:10763:x1876179311157120:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789264193.760072:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:10763:x1876179311157120:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 130us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264193.760087:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 324 00000100:00100000:3.0:1789264193.764886:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264193.765452:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311157248 00000100:00100000:2.0:1789264193.765462:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311157248 00000100:00100000:2.0:1789264193.765530:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 325 00000100:00100000:2.0:1789264193.765539:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:6166:x1876179311157248:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789264193.765554:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264193.765570:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5623c00/0xecaf9f2f14ed6e7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa75 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264193.765595:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5623c00/0xecaf9f2f14ed6e7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa75 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264193.765607:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5623c00/0xecaf9f2f14ed6e7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa75 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264193.765615:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623c00, rc 0) 00000100:00100000:2.0:1789264193.765671:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:6166:x1876179311157248:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 133us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264193.765678:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 325 00000100:00100000:3.0:1789264193.767052:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264193.767220:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311157376 00000100:00100000:2.0:1789264193.767228:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311157376 00000100:00100000:2.0:1789264193.767273:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 326 00000100:00100000:2.0:1789264193.767282:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:6166:x1876179311157376:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789264193.767424:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:6166:x1876179311157376:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 143us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264193.767432:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 326 00000100:00100000:3.0:1789264193.770623:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264193.770792:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311157504 00000100:00100000:0.0:1789264193.770802:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311157504 00000100:00100000:0.0:1789264193.770859:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 327 00000100:00100000:0.0:1789264193.770868:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:6166:x1876179311157504:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264193.770997:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:6166:x1876179311157504:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 Request processed in 129us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264193.771006:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 327 00000100:00100000:1.0:1789264193.778365:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264193.779713:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311157632 00000100:00100000:3.0:1789264193.779727:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311157632 00000100:00100000:3.0:1789264193.779890:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 328 00000100:00100000:3.0:1789264193.779903:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:10766:x1876179311157632:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789264193.780065:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:10766:x1876179311157632:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 164us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264193.780074:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 328 00000100:00100000:3.0:1789264193.783860:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264193.784108:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311157760 00000100:00100000:0.0:1789264193.784118:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311157760 00000100:00100000:0.0:1789264193.784246:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 329 00000100:00100000:0.0:1789264193.784258:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:10766:x1876179311157760:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789264193.784413:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:10766:x1876179311157760:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 156us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264193.784421:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 329 00000100:00100000:1.0:1789264194.058088:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789264194.058119:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322758528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789264194.058182:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264194.059769:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322758528 00000100:00100000:0.0:1789264194.059781:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322758528 00000100:00100000:0.0:1789264194.060165:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789264194.060178:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322758528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789264194.060221:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264194.060238:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322758656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789264194.060284:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264194.060300:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322758528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (2116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.060307:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1789264194.060330:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789264194.060391:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ea2300 x1876179322758528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264194.060411:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322758528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789264194.062665:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322758656 00000100:00100000:1.0:1789264194.062677:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322758656 00000100:00080000:3.0:1789264194.062808:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264194.066797:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789264194.066822:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322758656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789264194.066851:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264194.067141:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322758656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 331us (6856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264194.067149:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1789264194.067361:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c37100 x1876179322758656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264194.067383:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322758656:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789264194.186038:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789264194.186072:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789264194.186077:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3ab7f50000 from 7 10000000:01000000:3.0:1789264194.186082:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789264194.186127:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264194.186139:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264194.186150:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264194.186175:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322758784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789264194.186252:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264194.186590:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398307b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264194.186592:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322758784 00000100:00100000:2.0:1789264194.186611:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322758784 00000100:00100000:2.0:1789264194.186672:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789264194.186683:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:6487:x1876179322758784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789264194.186695:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264194.186707:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3ab5623600/0xecaf9f2f14ed6e8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6e86 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264194.186730:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3ab5623600/0xecaf9f2f14ed6e8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6e86 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264194.186974:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3ab5623600/0xecaf9f2f14ed6e8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6e86 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264194.186984:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623600, rc 0) 00000100:00100000:2.0:1789264194.187147:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322758784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 466us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264194.187155:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789264194.187433:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322758784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264194.187453:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6e8d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264194.187464:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6e8d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264194.187555:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322758912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264194.187592:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264194.187689:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398307b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264194.187985:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322758912 00000100:00100000:0.0:1789264194.187992:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322758912 00000100:00100000:0.0:1789264194.188075:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789264194.188084:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322758912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.188207:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322758912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.188225:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789264194.188291:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322758912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264194.188332:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322759040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264194.188373:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264194.192073:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322759040 00000100:00100000:1.0:1789264194.192087:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322759040 00000100:00100000:1.0:1789264194.192251:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789264194.192262:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322759040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789264194.192557:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322759040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 295us (4182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264194.192564:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789264194.194390:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398307b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264194.194422:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322759040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264194.195183:0:13755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13755:1876179322759168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264194.195259:0:13755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264194.195291:0:13755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398307b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789264194.195511:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322759168 00000100:00100000:1.0:1789264194.195518:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322759168 00000100:00100000:1.0:1789264194.195565:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789264194.195574:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:13755:x1876179322759168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264194.195686:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:13755:x1876179322759168:12345-0@lo:502:llog_process_th.0 Request processed in 112us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264194.195700:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789264194.196425:0:13755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13755:1876179322759168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789264194.196456:0:13755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264194.196466:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264194.196468:0:13755:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789264194.196474:0:13755:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c3ab7f50000 00000020:00000080:3.0:1789264194.196476:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789264194.196592:0:13755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264194.196596:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264194.196598:0:13755:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789264194.196601:0:13755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264194.196603:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264194.196605:0:13755:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789264194.196608:0:13755:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c3ab7f50000 00000020:00000080:3.0:1789264194.196610:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789264194.200491:0:13755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13755:1876179322759296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264194.200574:0:13755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264194.200627:0:13755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398307b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789264194.200850:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322759296 00000100:00100000:1.0:1789264194.200858:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322759296 00000100:00100000:1.0:1789264194.201420:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789264194.201431:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:13755:x1876179322759296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264194.201618:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:13755:x1876179322759296:12345-0@lo:502:llog_process_th.0 Request processed in 189us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264194.201626:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789264194.206393:0:13755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13755:1876179322759296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789264194.206436:0:13755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264194.206443:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264194.206445:0:13755:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789264194.206450:0:13755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789264194.206599:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789264194.206623:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789264194.206633:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6e8d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264194.206643:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6e8d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264194.206653:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789264194.206655:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3aba913000 from 7 10000000:01000000:2.0:1789264194.206657:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789264194.206686:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264194.206693:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264194.206701:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264194.206719:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322759424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789264194.206820:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264194.206853:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983784540 going to sleep for 11 seconds 00000100:00100000:0.0:1789264194.207055:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322759424 00000100:00100000:0.0:1789264194.207061:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322759424 00000100:00100000:0.0:1789264194.207108:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789264194.207117:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:6487:x1876179322759424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264194.207129:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264194.207141:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c398366b600/0xecaf9f2f14ed6e9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6e94 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.207162:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c398366b600/0xecaf9f2f14ed6e9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6e94 expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.207171:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c398366b600/0xecaf9f2f14ed6e9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6e94 expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.207178:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366b600, rc 0) 00000100:00100000:0.0:1789264194.207216:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322759424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.207228:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789264194.207266:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322759424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264194.207278:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6e9b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.207286:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6e9b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264194.207458:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322759552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.207485:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264194.207538:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835edf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789264194.209837:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322759552 00000100:00100000:2.0:1789264194.209851:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322759552 00000100:00100000:2.0:1789264194.210040:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789264194.210053:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322759552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789264194.210219:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322759552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (2732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264194.210228:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789264194.210360:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322759552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.210420:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322759680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.210480:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264194.210523:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264194.210543:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322759680 00000100:00100000:0.0:1789264194.210548:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322759680 00000100:00100000:0.0:1789264194.210585:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789264194.210593:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322759680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.210700:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322759680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.210708:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789264194.210796:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322759680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.211028:0:13758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13758:1876179322759808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264194.211067:0:13758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264194.211085:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322759808 00000100:00100000:0.0:1789264194.211088:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322759808 00000100:00100000:0.0:1789264194.211107:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789264194.211113:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:13758:x1876179322759808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264194.211174:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:13758:x1876179322759808:12345-0@lo:502:llog_process_th.0 Request processed in 60us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.211180:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789264194.211209:0:13758:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1789264194.211220:0:13758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13758:1876179322759808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789264194.211239:0:13758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789264194.211248:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264194.211250:0:13758:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789264194.211257:0:13758:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c3aba913000 00000020:00000080:0.0:1789264194.211259:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789264194.211306:0:13758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264194.211309:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264194.211311:0:13758:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789264194.211314:0:13758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789264194.211316:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264194.211317:0:13758:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789264194.211321:0:13758:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c3aba913000 00000020:00000080:0.0:1789264194.211323:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789264194.211352:0:13758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13758:1876179322759936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264194.211385:0:13758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264194.211403:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322759936 00000100:00100000:0.0:1789264194.211406:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322759936 00000100:00100000:0.0:1789264194.211425:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1789264194.211439:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:13758:x1876179322759936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264194.211489:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:13758:x1876179322759936:12345-0@lo:502:llog_process_th.0 Request processed in 51us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.211495:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1789264194.211522:0:13758:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1789264194.211532:0:13758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13758:1876179322759936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789264194.211547:0:13758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264194.211550:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264194.211551:0:13758:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789264194.211555:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789264194.211598:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789264194.211616:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789264194.211625:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6e9b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.211635:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6e9b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264194.211645:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789264194.211648:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3aae2b1800 from 7 10000000:01000000:0.0:1789264194.211650:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789264194.211669:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.211677:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.211686:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264194.211709:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322760064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.211761:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264194.211775:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1789264194.211786:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322760064 00000100:00100000:0.0:1789264194.211789:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322760064 00000100:00100000:0.0:1789264194.211814:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789264194.211819:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:6487:x1876179322760064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264194.211827:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264194.211837:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c398366a600/0xecaf9f2f14ed6ea9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6ea2 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.211856:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c398366a600/0xecaf9f2f14ed6ea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6ea2 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.211866:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c398366a600/0xecaf9f2f14ed6ea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6ea2 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.211875:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366a600, rc 0) 00000100:00100000:0.0:1789264194.211900:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322760064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.211905:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789264194.211931:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322760064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264194.211942:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.211950:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264194.211998:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322760192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.212023:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264194.212035:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1789264194.212045:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322760192 00000100:00100000:0.0:1789264194.212049:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322760192 00000100:00100000:0.0:1789264194.212068:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789264194.212074:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322760192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.212160:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322760192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.212166:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789264194.212194:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322760192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.212229:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322760320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.212261:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264194.212272:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1789264194.212282:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322760320 00000100:00100000:0.0:1789264194.212285:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322760320 00000100:00100000:0.0:1789264194.212302:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789264194.212306:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322760320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.212361:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322760320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 54us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.212367:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789264194.212399:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322760320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.212619:0:13759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13759:1876179322760448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264194.212671:0:13759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264194.212697:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322760448 00000100:00100000:0.0:1789264194.212701:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322760448 00000100:00100000:0.0:1789264194.212727:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789264194.212768:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:13759:x1876179322760448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264194.212852:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:13759:x1876179322760448:12345-0@lo:502:llog_process_th.0 Request processed in 117us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.212860:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789264194.212900:0:13759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835ed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264194.212915:0:13759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13759:1876179322760448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789264194.212939:0:13759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789264194.212947:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264194.212948:0:13759:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789264194.212955:0:13759:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c3aae2b1800 00000020:00000080:0.0:1789264194.212957:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789264194.212991:0:13759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264194.212994:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264194.212995:0:13759:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789264194.212998:0:13759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789264194.213000:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264194.213002:0:13759:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789264194.213005:0:13759:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c3aae2b1800 00000020:00000080:0.0:1789264194.213007:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789264194.213036:0:13759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13759:1876179322760576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264194.213068:0:13759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264194.213087:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322760576 00000100:00100000:0.0:1789264194.213091:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322760576 00000100:00100000:0.0:1789264194.213111:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789264194.213123:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:13759:x1876179322760576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264194.213181:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:13759:x1876179322760576:12345-0@lo:502:llog_process_th.0 Request processed in 58us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.213188:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789264194.213218:0:13759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264194.213230:0:13759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13759:1876179322760576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789264194.213248:0:13759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264194.213252:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264194.213253:0:13759:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789264194.213256:0:13759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789264194.213297:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789264194.213312:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789264194.213318:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.213326:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264194.213336:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789264194.213338:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3a89eb9800 from 7 10000000:01000000:0.0:1789264194.213340:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789264194.213357:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.213364:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.213372:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264194.213393:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322760704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.213418:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264194.213432:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835ed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264194.213443:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322760704 00000100:00100000:0.0:1789264194.213447:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322760704 00000100:00100000:0.0:1789264194.213468:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789264194.213474:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:6487:x1876179322760704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264194.213481:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264194.213490:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c398366a400/0xecaf9f2f14ed6eb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed6eb0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.213507:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c398366a400/0xecaf9f2f14ed6eb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6eb0 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.213516:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c398366a400/0xecaf9f2f14ed6eb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed6eb0 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.213523:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366a400, rc 0) 00000100:00100000:0.0:1789264194.213550:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322760704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.213555:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789264194.213585:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322760704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264194.213595:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.213604:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264194.213648:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322760832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.213672:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264194.213684:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835ed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264194.213695:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322760832 00000100:00100000:0.0:1789264194.213698:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322760832 00000100:00100000:0.0:1789264194.213717:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789264194.213723:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322760832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.219208:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322760832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5476us (5526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.219221:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789264194.220703:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322760832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789264194.220791:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322760960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789264194.220855:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264194.220905:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264194.221246:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322760960 00000100:00100000:0.0:1789264194.221253:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322760960 00000100:00100000:0.0:1789264194.221303:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789264194.221405:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322760960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264194.221510:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:6487:x1876179322760960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.221517:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789264194.221593:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:6487:1876179322760960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789264194.222109:0:13761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13761:1876179322761088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264194.222150:0:13761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264194.222181:0:13761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789264194.222229:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322761088 00000100:00100000:0.0:1789264194.222234:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322761088 00000100:00100000:0.0:1789264194.222294:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789264194.222302:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:13761:x1876179322761088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264194.222399:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:13761:x1876179322761088:12345-0@lo:502:llog_process_th.0 Request processed in 97us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264194.222406:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789264194.222475:0:13761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13761:1876179322761088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789264194.222499:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789264194.222509:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264194.222512:0:13761:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789264194.222518:0:13761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c3a89eb9800 00000020:00000080:1.0:1789264194.222520:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789264194.222579:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264194.222583:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264194.222589:0:13761:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789264194.222593:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789264194.222595:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264194.222596:0:13761:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789264194.222600:0:13761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c3a89eb9800 00000020:00000080:1.0:1789264194.222602:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789264194.222636:0:13761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13761:1876179322761216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264194.222667:0:13761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789264194.224287:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789264194.226549:0:13761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789264194.229258:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322761216 00000100:00100000:3.0:1789264194.229273:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322761216 00000100:00100000:3.0:1789264194.229401:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789264194.229414:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:13761:x1876179322761216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264194.229571:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:13761:x1876179322761216:12345-0@lo:502:llog_process_th.0 Request processed in 160us (6902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264194.229578:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789264194.230040:0:13761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:13761:1876179322761216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789264194.230075:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264194.230083:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264194.230085:0:13761:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789264194.230090:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789264194.232033:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789264194.232066:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789264194.232077:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.232088:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789264194.238137:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789264194.570682:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789264194.570707:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322761344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789264194.570813:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264194.571005:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322761344 00000100:00100000:3.0:1789264194.571013:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322761344 00000100:00100000:3.0:1789264194.571076:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789264194.571087:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322761344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789264194.571118:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789264194.571164:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322761344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264194.571171:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789264194.571258:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322761344:0@lo:41:osp-pre-0-1.0 00000004:00080000:1.0:1789264194.573279:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789264194.573365:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1789264194.573375:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1789264194.573440:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6dc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573452:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6dc2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573460:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6dc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573466:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264194.573471:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6dc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573479:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6dc2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573495:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff9c3ab7e7c900) 00010000:00010000:0.0:1789264194.573498:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264194.573514:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6dc2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573521:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6dc2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573541:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6dd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573547:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6dd7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573553:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6dd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573558:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264194.573562:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6dd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573567:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6dd7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573575:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c3ab7e7c100) 00010000:00010000:0.0:1789264194.573577:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264194.573580:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6dd7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573585:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6dd7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573600:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6e40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573606:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6e40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573618:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6e40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573623:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264194.573626:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6e40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573632:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6e40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573640:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff9c3ab7e7c900) 00010000:00010000:0.0:1789264194.573642:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264194.573645:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6e40 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573651:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed6e40 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573666:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573673:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573678:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573683:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264194.573686:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573702:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573710:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c3983361a00) 00010000:00010000:0.0:1789264194.573712:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264194.573715:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e5c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.573720:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed6e5c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264194.574190:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322761472:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789264194.574251:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264194.574335:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322761472 00000100:00100000:0.0:1789264194.574342:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322761472 00000100:00100000:0.0:1789264194.574405:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789264194.574415:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322761472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789264194.574438:0:10317:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1789264194.574468:0:10317:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa6013c, atime: 0x6aa6013c, ctime: 0x6aa6013c, blocks: 0x0 00010000:00010000:0.0:1789264194.574475:0:10317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed6ebe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.574489:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=274s v=(0 0) 00010000:00010000:0.0:1789264194.574493:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264194.574499:0:10317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed6ebe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.574514:0:10317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed6ebe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.574536:0:10317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed6ebe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.574543:0:10317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed6ebe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264194.574558:0:10317:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1789264194.574793:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789264194.574818:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264194.574825:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed6ebe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264194.574834:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366bc00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264194.574838:0:7431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed6ebe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264194.574858:0:7431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed6ebe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264194.574874:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed6ebe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264194.574894:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed6ebe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264194.574911:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264194.574912:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264194.574914:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264194.575362:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322761472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 947us (1109us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789264194.575370:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1789264194.575543:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c398364ca80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789264194.575550:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322761472:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789264195.210064:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789264195.274544:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789264195.276093:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789264196.234440:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264196.618016:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322761728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264196.618251:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264196.618455:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322761728 00000100:00100000:1.0:1789264196.618463:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322761728 00000100:00100000:1.0:1789264196.618535:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789264196.618546:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322761728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789264196.618572:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264196.618619:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322761728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264196.618627:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789264196.618828:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789264196.618868:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322761728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264196.619014:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789264196.619027:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322761600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264196.619061:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264196.619362:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322761984:0@lo:400:kworker.0 00000100:00100000:0.0:1789264196.619394:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264196.619628:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322761856:0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.619650:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264196.619826:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322762240:0@lo:400:kworker.0 00000100:00100000:1.0:1789264196.619856:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264196.621220:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322762368:0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.621269:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264196.621298:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322762880:0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.621321:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264196.621371:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322761856 00000100:00100000:2.0:1789264196.621378:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322761856 00000100:00100000:2.0:1789264196.621427:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789264196.621436:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3625:x1876179322761856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.621486:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3625:x1876179322761856:12345-0@lo:400:kworker.0 Request processed in 52us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264196.621493:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789264196.621523:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322762368 00000100:00100000:2.0:1789264196.621526:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322762368 00000100:00100000:2.0:1789264196.621576:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789264196.621584:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322762368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.621616:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322762368:12345-0@lo:400:kworker.0 Request processed in 34us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264196.621622:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789264196.621652:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322761856:0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.621662:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322762368:0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.621701:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322762112:0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.621735:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264196.622061:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322762752:0@lo:400:kworker.0 00000100:00100000:1.0:1789264196.622096:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264196.622130:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322762880 00000100:00100000:1.0:1789264196.622134:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322762880 00000100:00100000:1.0:1789264196.622170:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322762752 00000100:00100000:1.0:1789264196.622173:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322762752 00000100:00100000:1.0:1789264196.622193:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789264196.622199:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322762880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264196.622237:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322762880:12345-0@lo:400:kworker.0 Request processed in 38us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264196.622243:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789264196.622256:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789264196.622262:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322762752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264196.622292:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322762752:12345-0@lo:400:kworker.0 Request processed in 30us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264196.622298:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1789264196.622326:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ea0e00 x1876179322762880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264196.622337:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322762880:0@lo:400:kworker.0 00010000:00080000:1.0:1789264196.622360:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ea1180 x1876179322762752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264196.622368:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322762752:0@lo:400:kworker.0 00000100:00100000:1.0:1789264196.622396:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322762496:0@lo:400:kworker.0 00000100:00100000:1.0:1789264196.622423:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264196.622441:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322763008:0@lo:400:kworker.0 00000100:00100000:1.0:1789264196.622460:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264196.622505:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322761984 00000100:00100000:1.0:1789264196.622509:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322761984 00000100:00100000:1.0:1789264196.622532:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322762240 00000100:00100000:1.0:1789264196.622535:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322762240 00000100:00100000:2.0:1789264196.622591:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1876179322762624:0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.622615:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264196.622627:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322763136:0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.622645:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264196.622673:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322762112 00000100:00100000:2.0:1789264196.622677:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322762112 00000100:00100000:2.0:1789264196.622707:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789264196.622724:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322762112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.622832:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322762112:12345-0@lo:400:kworker.0 Request processed in 118us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264196.622838:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789264196.622865:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322762112:0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.622891:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322762496 00000100:00100000:2.0:1789264196.622895:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322762496 00000100:00100000:2.0:1789264196.622912:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322763008 00000100:00100000:2.0:1789264196.622914:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322763008 00000100:00100000:2.0:1789264196.622938:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322762624 00000100:00100000:2.0:1789264196.622941:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322762624 00000100:00100000:2.0:1789264196.623070:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322763136 00000100:00100000:2.0:1789264196.623074:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322763136 00000100:00100000:2.0:1789264196.623089:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789264196.623095:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322761984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264196.623160:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322761600 00000100:00100000:3.0:1789264196.623166:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322761600 00000100:00100000:3.0:1789264196.623204:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789264196.623212:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1876179322761600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789264196.623227:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264196.623312:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322761984:12345-0@lo:400:kworker.0 Request processed in 216us (3916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264196.623319:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789264196.623334:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789264196.623342:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322762240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264196.623367:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1876179322761600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (4303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264196.623374:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789264196.623485:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322762240:12345-0@lo:400:kworker.0 Request processed in 144us (3626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264196.623491:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789264196.623505:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789264196.623512:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322762496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.623540:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322762496:12345-0@lo:400:kworker.0 Request processed in 29us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264196.623546:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789264196.623557:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789264196.623564:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322763008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.623592:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322763008:12345-0@lo:400:kworker.0 Request processed in 30us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264196.623598:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789264196.623611:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789264196.623617:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1876179322762624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264196.623675:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322761600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264196.623684:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1876179322762624:12345-0@lo:400:kworker.0 Request processed in 66us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264196.623692:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789264196.623708:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789264196.623726:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1876179322763136:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789264196.623729:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789264196.623735:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789264196.623738:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789264196.623741:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789264196.623782:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322762240:0@lo:400:kworker.0 00000100:00100000:1.0:1789264196.623887:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322761984:0@lo:400:kworker.0 00000100:00100000:1.0:1789264196.623897:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322762496:0@lo:400:kworker.0 00000100:00100000:1.0:1789264196.623906:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322763008:0@lo:400:kworker.0 00010000:00080000:3.0:1789264196.623948:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ea1f80 x1876179322762624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264196.623960:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1876179322762624:0@lo:400:kworker.0 00000100:00100000:2.0:1789264196.623969:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1876179322763136:12345-0@lo:400:kworker.0 Request processed in 253us (1320us total) trans 0 rc 0/0 00010000:00080000:3.0:1789264196.623975:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ea0a80 x1876179322763136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264196.623979:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789264196.623990:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322763136:0@lo:400:kworker.0 00000100:00100000:1.0:1789264197.132895:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789264197.132919:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322763264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789264197.132989:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264197.133163:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322763264 00000100:00100000:2.0:1789264197.133171:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322763264 00000100:00100000:2.0:1789264197.133260:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789264197.133271:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322763264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789264197.133303:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789264197.133361:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322763264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264197.133368:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789264197.133500:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322763264:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789264197.258492:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264197.583664:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264197.583724:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264197.583859:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311158016 00000100:00100000:0.0:1789264197.583870:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311158016 00000100:00100000:0.0:1789264197.583944:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 154 00000100:00100000:0.0:1789264197.583954:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311158016:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264197.584024:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311158016:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 72us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264197.584032:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 154 00000100:00080000:3.0:1789264197.584183:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264197.584521:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311157888 00000100:00100000:2.0:1789264197.584526:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311157888 00000100:00100000:2.0:1789264197.584570:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 351 00000100:00100000:2.0:1789264197.584579:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2404:x1876179311157888:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264197.584622:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2404:x1876179311157888:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 44us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264197.584629:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 351 00000100:00100000:1.0:1789264197.590062:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264197.590109:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264197.590147:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264197.590191:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264197.590265:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311158272 00000100:00100000:3.0:1789264197.590275:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311158272 00000100:00100000:3.0:1789264197.590356:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:3.0:1789264197.590374:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311158272:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264197.590458:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311158272:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 93us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264197.590466:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00080000:1.0:1789264197.590838:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789264197.591007:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311158144 00000100:00100000:2.0:1789264197.591014:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311158144 00000100:00100000:2.0:1789264197.591068:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311158400 00000100:00100000:2.0:1789264197.591085:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311158400 00000100:00100000:2.0:1789264197.591119:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311158528 00000100:00100000:2.0:1789264197.591122:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311158528 00000100:00100000:2.0:1789264197.591142:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 155 00000100:00100000:2.0:1789264197.591149:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311158144:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264197.591197:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311158144:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 48us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264197.591203:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 155 00000100:00100000:2.0:1789264197.591217:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 156 00000100:00100000:2.0:1789264197.591224:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311158400:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264197.591248:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311158400:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264197.591254:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 156 00000100:00100000:2.0:1789264197.591265:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 157 00000100:00100000:2.0:1789264197.591272:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311158528:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264197.591294:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311158528:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264197.591301:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 157 00000100:00080000:1.0:1789264197.591766:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789264197.591771:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789264198.281968:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264199.178046:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322763392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789264199.178121:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264199.178311:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322763392 00000100:00100000:1.0:1789264199.178320:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322763392 00000100:00100000:1.0:1789264199.178394:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789264199.178404:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abb1b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322763392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789264199.178435:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264199.178474:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322763520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789264199.178489:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abb1b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322763392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (367us total) trans 0 rc 0/0 00000100:00080000:2.0:1789264199.178533:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789264199.180620:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ea2300 x1876179322763392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264199.180643:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322763392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789264199.182177:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789264199.183875:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264199.184081:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322763520 00000100:00100000:3.0:1789264199.184090:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322763520 00000100:00100000:3.0:1789264199.184165:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789264199.184175:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322763520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789264199.184196:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264199.184262:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322763520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264199.184270:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1789264199.184309:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ea0a80 x1876179322763520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264199.184329:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322763520:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789264199.184436:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789264199.306044:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264199.691076:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322763648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789264199.691151:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264199.691385:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322763648 00000100:00100000:2.0:1789264199.691393:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322763648 00000100:00100000:2.0:1789264199.691451:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789264199.691461:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f344850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322763648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789264199.691492:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789264199.691545:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f344850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322763648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264199.691553:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789264199.691904:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322763648:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789264200.329978:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789264200.715372:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:2.0:1789264201.353971:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264201.738051:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322763776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789264201.738120:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264201.738408:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322763776 00000100:00100000:1.0:1789264201.738416:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322763776 00000100:00100000:1.0:1789264201.738481:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789264201.738492:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322763776:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789264201.738602:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789264201.738674:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264201.738740:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322763776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 250us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264201.738775:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789264201.738845:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1789264201.738851:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c398364ca80, transno 4294967301 00000100:00100000:3.0:1789264201.738875:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322763776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264201.739706:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322763904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264201.739778:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264201.740623:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322763904 00000100:00100000:3.0:1789264201.740633:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322763904 00000100:00100000:3.0:1789264201.740717:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789264201.740727:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322763904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789264201.740769:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789264201.740852:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789264201.743165:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322764160:0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.743234:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264201.743307:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789264201.743314:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322764032:0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.743343:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264201.743382:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322764160 00000100:00100000:0.0:1789264201.743389:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322764160 00000100:00100000:0.0:1789264201.743437:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789264201.743447:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322764160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.743499:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322764160:12345-0@lo:400:kworker.0 Request processed in 53us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264201.743507:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789264201.743559:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322764160:0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.743582:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322764288:0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.743655:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264201.743720:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322764032 00000100:00100000:0.0:1789264201.743725:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322764032 00000100:00100000:0.0:1789264201.743783:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1789264201.743790:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3623:x1876179322764032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.743826:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3623:x1876179322764032:12345-0@lo:400:kworker.0 Request processed in 36us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264201.743845:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1789264201.743879:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322764032:0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.743920:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322764288 00000100:00100000:0.0:1789264201.743923:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322764288 00000100:00100000:0.0:1789264201.743954:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789264201.743960:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322764288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.743995:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322764288:12345-0@lo:400:kworker.0 Request processed in 36us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264201.744001:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789264201.744027:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322764288:0@lo:400:kworker.0 00000100:00100000:3.0:1789264201.746760:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322763904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6009us (6955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264201.746775:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789264201.752151:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322763904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264201.753348:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322764416:0@lo:400:kworker.0 00000100:00100000:2.0:1789264201.753418:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264201.753638:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322764672:0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.753734:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322764800:0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.753803:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322764544:0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.753830:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264201.753975:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322764416 00000100:00100000:3.0:1789264201.753983:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322764416 00000100:00100000:3.0:1789264201.754040:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789264201.754050:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322764416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.758557:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322765056:0@lo:400:kworker.0 00000100:00100000:1.0:1789264201.758580:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264201.758604:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264201.758636:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322765184:0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.758668:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322764672 00000100:00100000:0.0:1789264201.758676:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322764672 00000100:00100000:0.0:1789264201.758739:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789264201.758765:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322764672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264201.758951:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264201.758986:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322765184 00000100:00100000:1.0:1789264201.758991:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322765184 00000100:00100000:1.0:1789264201.759022:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789264201.759030:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322765184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264201.759069:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322765184:12345-0@lo:400:kworker.0 Request processed in 39us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264201.759076:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789264201.759117:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322765184:0@lo:400:kworker.0 00000100:00100000:1.0:1789264201.759158:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322765056 00000100:00100000:1.0:1789264201.759162:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322765056 00000100:00100000:1.0:1789264201.759190:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789264201.759197:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322765056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264201.759233:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322765056:12345-0@lo:400:kworker.0 Request processed in 36us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264201.759254:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789264201.759973:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264201.761356:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322764672:12345-0@lo:400:kworker.0 Request processed in 2587us (2771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264201.761369:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789264201.761390:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322765312:0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.761400:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322764800 00000100:00100000:0.0:1789264201.761407:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322764800 00000100:00100000:1.0:1789264201.761437:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264201.761455:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322765312 00000100:00100000:0.0:1789264201.761460:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322765312 00000100:00100000:0.0:1789264201.761483:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789264201.761490:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322764800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264201.761602:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789264201.761611:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322764928:0@lo:400:kworker.0 00000100:00100000:1.0:1789264201.761640:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264201.761821:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322764928 00000100:00100000:1.0:1789264201.761825:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322764928 00000100:00100000:1.0:1789264201.761856:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789264201.761863:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322764928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264201.761901:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322764928:12345-0@lo:400:kworker.0 Request processed in 38us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264201.761908:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789264201.761931:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789264201.761938:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322765312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264201.761967:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322765312:12345-0@lo:400:kworker.0 Request processed in 30us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264201.761973:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789264201.762005:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322764544 00000100:00100000:1.0:1789264201.762010:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322764544 00000100:00100000:1.0:1789264201.762040:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789264201.762046:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322764544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264201.762080:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322764544:12345-0@lo:400:kworker.0 Request processed in 34us (8250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264201.762086:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1789264201.762140:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac6aa00 x1876179322764928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264201.762153:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322764928:0@lo:400:kworker.0 00010000:00080000:1.0:1789264201.762164:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac69880 x1876179322765312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264201.762171:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322765312:0@lo:400:kworker.0 00000100:00080000:1.0:1789264201.762215:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789264201.762220:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789264201.762222:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264201.762245:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322764544:0@lo:400:kworker.0 00010000:00080000:1.0:1789264201.762259:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac6b800 x1876179322765056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264201.762268:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322765056:0@lo:400:kworker.0 00000100:00100000:1.0:1789264201.762797:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322764672:0@lo:400:kworker.0 00000100:00100000:0.0:1789264201.766322:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322764800:12345-0@lo:400:kworker.0 Request processed in 4821us (7034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264201.766336:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789264201.766399:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322764416:12345-0@lo:400:kworker.0 Request processed in 12349us (12978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264201.766423:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789264201.766527:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322764416:0@lo:400:kworker.0 00010000:00080000:1.0:1789264201.770174:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abac6b480 x1876179322764800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264201.770194:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322764800:0@lo:400:kworker.0 00000100:00100000:1.0:1789264202.249987:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789264202.250013:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322765440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789264202.250081:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264202.250245:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322765440 00000100:00100000:0.0:1789264202.250253:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322765440 00000100:00100000:0.0:1789264202.250347:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789264202.250357:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322765440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789264202.250389:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789264202.250454:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322765440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264202.250463:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789264202.250653:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322765440:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789264202.379783:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264202.703167:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264202.703211:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264202.703237:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264202.703408:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311158784 00000100:00100000:0.0:1789264202.703418:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311158784 00000100:00100000:1.0:1789264202.703425:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264202.703475:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264202.703525:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311159040 00000100:00100000:3.0:1789264202.703530:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311159040 00000100:00100000:3.0:1789264202.703568:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:3.0:1789264202.703578:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311159040:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264202.703649:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311159040:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 73us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264202.703657:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:3.0:1789264202.703689:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311158656 00000100:00100000:3.0:1789264202.703693:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311158656 00000100:00100000:3.0:1789264202.703721:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 353 00000100:00100000:3.0:1789264202.703729:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2405:x1876179311158656:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264202.703783:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2405:x1876179311158656:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 55us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264202.703790:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 353 00000100:00080000:3.0:1789264202.703840:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789264202.703844:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264202.703919:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264202.705706:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311159296 00000100:00100000:0.0:1789264202.705719:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311159296 00000100:00100000:2.0:1789264202.705812:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311159168 00000100:00100000:2.0:1789264202.705818:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311159168 00000100:00100000:2.0:1789264202.705886:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 164 00000100:00100000:2.0:1789264202.705897:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311158784:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264202.706017:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 165 00000100:00100000:0.0:1789264202.706027:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311159296:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264202.707527:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311158912 00000100:00100000:3.0:1789264202.707543:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311158912 00000100:00100000:3.0:1789264202.707610:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 166 00000100:00100000:3.0:1789264202.707622:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311159168:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264202.709452:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311158784:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 3546us (6283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264202.709467:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 164 00000100:00100000:2.0:1789264202.709519:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 167 00000100:00100000:2.0:1789264202.709534:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311158912:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264202.709579:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311158912:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 53us (6104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264202.709586:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 167 00000100:00080000:2.0:1789264202.709631:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789264202.709636:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789264202.716559:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311159296:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 10522us (13309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264202.716575:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 165 00000100:00100000:3.0:1789264202.719214:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311159168:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 11584us (15283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264202.719230:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 166 00010000:00010000:3.0:1789264203.408569:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264204.300482:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322765568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789264204.300554:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264204.300697:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322765568 00000100:00100000:2.0:1789264204.300706:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322765568 00000100:00100000:2.0:1789264204.300794:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789264204.300810:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322765568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789264204.300842:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264204.300893:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322765568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264204.300901:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1789264204.300964:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789264204.300994:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39826a3480 x1876179322765568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264204.301012:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322765568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789264204.301029:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789264204.301035:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322765696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789264204.301060:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264204.301872:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322765696 00000100:00100000:2.0:1789264204.301881:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322765696 00000100:00100000:2.0:1789264204.301948:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789264204.301959:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322765696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789264204.301976:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264204.302035:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322765696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264204.302042:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1789264204.302131:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ea0e00 x1876179322765696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264204.302150:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322765696:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789264204.302221:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789264204.426012:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264204.810053:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322765824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789264204.810126:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264204.810253:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322765824 00000100:00100000:0.0:1789264204.810261:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322765824 00000100:00100000:0.0:1789264204.810316:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789264204.810325:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322765824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789264204.810367:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789264204.810412:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322765824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264204.810419:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789264204.810489:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322765824:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789264205.449973:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789264205.516102:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789264205.517316:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789264206.474202:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264206.858293:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322766208:0@lo:400:kworker.0 00000100:00100000:3.0:1789264206.858544:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264206.858606:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322766720:0@lo:400:kworker.0 00000100:00100000:3.0:1789264206.858630:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264206.858661:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322767232:0@lo:400:kworker.0 00000100:00100000:3.0:1789264206.858684:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264206.858711:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789264206.858717:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322766080:0@lo:400:kworker.0 00000100:00100000:3.0:1789264206.858773:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264206.858800:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322766592:0@lo:400:kworker.0 00000100:00100000:2.0:1789264206.858805:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322766208 00000100:00100000:2.0:1789264206.858814:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322766208 00000100:00100000:3.0:1789264206.858827:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264206.858847:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322767104:0@lo:400:kworker.0 00000100:00100000:3.0:1789264206.858872:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264206.858891:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322767616:0@lo:400:kworker.0 00000100:00100000:2.0:1789264206.858893:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322766720 00000100:00100000:2.0:1789264206.858899:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322766720 00000100:00100000:3.0:1789264206.858917:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264206.858931:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322767232 00000100:00100000:2.0:1789264206.858936:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322767232 00000100:00100000:3.0:1789264206.858956:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789264206.859510:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322767104 00000100:00100000:1.0:1789264206.859515:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322767104 00000100:00100000:1.0:1789264206.859545:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322767616 00000100:00100000:1.0:1789264206.859548:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322767616 00000100:00100000:1.0:1789264206.859566:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789264206.859573:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322767104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.859631:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322767104:12345-0@lo:400:kworker.0 Request processed in 58us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264206.859638:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789264206.859662:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789264206.859677:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322767616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.859707:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322767616:12345-0@lo:400:kworker.0 Request processed in 32us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264206.859713:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1789264206.859735:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789264206.859739:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264206.859851:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322766080 00000100:00100000:0.0:1789264206.859855:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322766080 00000100:00100000:0.0:1789264206.859888:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789264206.859895:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3623:x1876179322766080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264206.859929:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3623:x1876179322766080:12345-0@lo:400:kworker.0 Request processed in 36us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264206.859934:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789264206.860108:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322766208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264206.860144:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322766208:12345-0@lo:400:kworker.0 Request processed in 1180us (1600us total) trans 0 rc 0/0 00000100:00080000:1.0:1789264206.860191:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264206.860202:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789264206.860214:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322767744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789264206.860244:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264206.860289:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322766080:0@lo:400:kworker.0 00010000:00080000:1.0:1789264206.860323:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c8b800 x1876179322767104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264206.860337:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322767104:0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.860349:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322767616:0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.860360:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322766208:0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.860407:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322766592 00000100:00100000:1.0:1789264206.860411:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322766592 00000100:00100000:1.0:1789264206.860446:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789264206.860453:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322766592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.860492:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322766592:12345-0@lo:400:kworker.0 Request processed in 40us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264206.860499:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789264206.860521:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322766336:0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.860556:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264206.860574:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322766848:0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.860597:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264206.860609:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322767360:0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.860627:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264206.860641:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789264206.860658:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322765952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264206.860679:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264206.860699:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322766464:0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.860720:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264206.860731:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322766976:0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.860784:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264206.860804:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322767488:0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.860825:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264206.860849:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322766976 00000100:00100000:1.0:1789264206.860853:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322766976 00000100:00100000:1.0:1789264206.860887:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322767488 00000100:00100000:1.0:1789264206.860890:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322767488 00000100:00100000:1.0:1789264206.860907:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789264206.860913:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322766976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.860946:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322766976:12345-0@lo:400:kworker.0 Request processed in 33us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264206.860951:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789264206.860961:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789264206.860979:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322767488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.861018:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322767488:12345-0@lo:400:kworker.0 Request processed in 39us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264206.861024:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1789264206.861044:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789264206.861047:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264206.861053:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322766336 00000100:00100000:1.0:1789264206.861057:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322766336 00000100:00100000:1.0:1789264206.861080:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789264206.861087:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322766336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.861115:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322766336:12345-0@lo:400:kworker.0 Request processed in 29us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264206.861120:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789264206.861140:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322767744 00000100:00100000:1.0:1789264206.861144:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322767744 00000100:00100000:1.0:1789264206.861165:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322765952 00000100:00100000:1.0:1789264206.861168:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322765952 00000100:00100000:1.0:1789264206.861181:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789264206.861188:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322767744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789264206.861208:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264206.861242:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322767744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264206.861248:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789264206.861260:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789264206.861266:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322765952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789264206.861274:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264206.861296:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322765952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264206.861312:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789264206.861347:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322767744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789264206.861371:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322765952:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789264206.861380:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c88380 x1876179322766976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264206.861389:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322766976:0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.861396:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322767488:0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.861404:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322766336:0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.861429:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322766592:0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.861474:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322766848 00000100:00100000:1.0:1789264206.861477:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322766848 00000100:00100000:2.0:1789264206.862844:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789264206.863081:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322766720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264206.863158:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322766720:12345-0@lo:400:kworker.0 Request processed in 303us (4525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264206.863166:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789264206.863189:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322767360 00000100:00100000:2.0:1789264206.863194:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322767360 00000100:00100000:2.0:1789264206.863218:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322766464 00000100:00100000:2.0:1789264206.863220:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322766464 00000100:00100000:2.0:1789264206.863233:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789264206.863240:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322767232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264206.863271:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322767232:12345-0@lo:400:kworker.0 Request processed in 32us (4586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264206.863277:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789264206.863288:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789264206.863295:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322767360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264206.863328:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322767360:12345-0@lo:400:kworker.0 Request processed in 34us (2699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264206.863334:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789264206.863344:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789264206.863350:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322766464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264206.863372:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322766464:12345-0@lo:400:kworker.0 Request processed in 23us (2652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264206.863391:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789264206.863432:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322766464:0@lo:400:kworker.0 00010000:00080000:2.0:1789264206.863445:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c89c00 x1876179322767360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264206.863456:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322767360:0@lo:400:kworker.0 00000100:00100000:2.0:1789264206.863492:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322766720:0@lo:400:kworker.0 00000100:00100000:2.0:1789264206.863501:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322767232:0@lo:400:kworker.0 00000100:00080000:2.0:1789264206.863562:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789264206.865272:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789264206.865431:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789264206.865448:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322766848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264206.865573:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322766848:12345-0@lo:400:kworker.0 Request processed in 134us (4975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264206.865578:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00010000:00080000:3.0:1789264206.865809:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c8ad80 x1876179322766848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264206.865825:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322766848:0@lo:400:kworker.0 00000100:00100000:3.0:1789264207.370459:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322767872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789264207.370547:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264207.370831:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322767872 00000100:00100000:1.0:1789264207.370839:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322767872 00000100:00100000:1.0:1789264207.370893:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789264207.370902:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322767872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789264207.370930:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789264207.374010:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322767872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3101us (3455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264207.374041:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789264207.376479:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322767872:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789264207.498773:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264207.823789:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264207.823829:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264207.823875:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264207.824014:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311159680 00000100:00100000:0.0:1789264207.824023:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311159680 00000100:00100000:0.0:1789264207.824083:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311159552 00000100:00100000:0.0:1789264207.824086:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311159552 00000100:00100000:0.0:1789264207.824109:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 174 00000100:00100000:0.0:1789264207.824119:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311159680:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264207.824194:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311159680:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 76us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264207.824202:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 174 00000100:00100000:0.0:1789264207.824222:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 175 00000100:00100000:0.0:1789264207.824229:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311159552:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264207.824265:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311159552:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264207.824272:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 175 00000100:00080000:1.0:1789264207.824552:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789264207.824558:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789264207.824668:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311159424 00000100:00100000:3.0:1789264207.824673:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311159424 00000100:00100000:3.0:1789264207.824718:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 355 00000100:00100000:3.0:1789264207.824727:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2404:x1876179311159424:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264207.824791:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2404:x1876179311159424:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 65us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264207.824797:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 355 00000100:00100000:1.0:1789264207.838542:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264207.838589:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264207.838800:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311159808 00000100:00100000:2.0:1789264207.838811:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311159808 00000100:00100000:2.0:1789264207.838881:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:2.0:1789264207.838897:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2401:x1876179311159808:12345-192.168.203.44@tcp:9:kworker.0 00000020:00000080:2.0:1789264207.838926:0:8403:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6de5 00000100:00080000:2.0:1789264207.838935:0:8403:0:(import.c:65:import_set_state_nolock()) ffff9c3983e5f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789264207.838977:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1789264207.839128:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+2:2401:x1876179311159808:12345-192.168.203.44@tcp:9:kworker.0 Request processed in 237us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264207.839137:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27 00010000:00010000:2.0:1789264207.839158:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789264207.839241:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789264207.840102:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264207.840371:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311159936 00000100:00100000:3.0:1789264207.840380:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311159936 00000100:00100000:3.0:1789264207.840457:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311160064 00000100:00100000:3.0:1789264207.840460:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311160064 00000100:00100000:3.0:1789264207.840490:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 176 00000100:00100000:3.0:1789264207.840500:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311159936:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264207.840569:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311159936:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 70us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264207.840576:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 176 00000100:00100000:3.0:1789264207.840594:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 177 00000100:00100000:3.0:1789264207.840618:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311160064:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264207.840665:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311160064:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 40us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264207.840672:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 177 00000100:00080000:1.0:1789264207.841230:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789264207.841235:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789264208.522937:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264209.418308:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789264209.418332:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322768000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789264209.418396:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264209.418558:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322768000 00000100:00100000:1.0:1789264209.418567:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322768000 00000100:00100000:1.0:1789264209.418652:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789264209.418678:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322768128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789264209.418711:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789264209.418885:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789264209.418970:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322768128 00000100:00100000:2.0:1789264209.418975:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322768128 00000100:00100000:2.0:1789264209.419025:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789264209.419035:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322768128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789264209.419078:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264209.419128:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322768128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264209.419135:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1789264209.419188:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264209.419226:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322768000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789264209.419237:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264209.419274:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322768000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 615us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264209.419280:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1789264209.419345:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ea3100 x1876179322768000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264209.419372:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322768000:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789264209.419373:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ea0000 x1876179322768128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264209.419392:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322768128:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789264209.545953:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264209.930078:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789264209.930101:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322768256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789264209.930183:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264209.930419:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322768256 00000100:00100000:1.0:1789264209.930427:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322768256 00000100:00100000:1.0:1789264209.930487:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789264209.930496:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322768256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789264209.930526:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789264209.930582:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322768256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264209.930588:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789264209.930717:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322768256:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789264210.574142:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264211.599729:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264211.979870:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789264211.979897:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322768384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789264211.979963:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264211.980040:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322768384 00000100:00100000:0.0:1789264211.980047:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322768384 00000100:00100000:0.0:1789264211.980117:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789264211.980126:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322768384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789264211.980152:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264211.980197:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322768384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264211.980205:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789264211.980254:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322768384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789264211.980294:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322768512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789264211.980320:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264211.980547:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322768512 00000100:00100000:2.0:1789264211.980553:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322768512 00000100:00100000:2.0:1789264211.980594:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789264211.980604:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322768512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789264211.980630:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264211.980647:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322768768:0@lo:400:kworker.0 00000100:00100000:2.0:1789264211.980667:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322768512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264211.980674:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789264211.980688:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264211.980710:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322769024:0@lo:400:kworker.0 00000100:00080000:3.0:1789264211.980769:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789264211.980781:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322768896:0@lo:400:kworker.0 00000100:00100000:2.0:1789264211.980823:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264211.980831:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322768640:0@lo:400:kworker.0 00000100:00100000:2.0:1789264211.980853:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322769408:0@lo:400:kworker.0 00000100:00100000:0.0:1789264211.980884:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264211.980926:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322768896 00000100:00100000:3.0:1789264211.980931:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322768896 00000100:00100000:3.0:1789264211.980981:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789264211.980988:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322768896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264211.981032:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322768896:12345-0@lo:400:kworker.0 Request processed in 45us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264211.981038:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789264211.982035:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322769280:0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.982074:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264211.982110:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322769792:0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.982132:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264211.982184:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264211.982289:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322769536:0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.982315:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264211.982367:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322768512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264211.982395:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322769536 00000100:00100000:1.0:1789264211.982400:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322769536 00000100:00100000:1.0:1789264211.982442:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789264211.982450:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322769536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.982491:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322769536:12345-0@lo:400:kworker.0 Request processed in 43us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264211.982498:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1789264211.982515:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789264211.982537:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c8b800 x1876179322769536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264211.982548:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322769536:0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.982564:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322768768 00000100:00100000:1.0:1789264211.982568:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322768768 00000100:00100000:1.0:1789264211.982594:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322769280 00000100:00100000:1.0:1789264211.982598:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322769280 00000100:00100000:1.0:1789264211.982631:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322769792 00000100:00100000:1.0:1789264211.982645:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322769792 00000100:00100000:1.0:1789264211.982668:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322769024 00000100:00100000:1.0:1789264211.982671:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322769024 00000100:00100000:1.0:1789264211.982683:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789264211.982689:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322768768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.982725:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322768768:12345-0@lo:400:kworker.0 Request processed in 36us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264211.982732:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789264211.982766:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789264211.982772:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322769280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.982796:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322769280:12345-0@lo:400:kworker.0 Request processed in 25us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264211.982801:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789264211.982811:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789264211.982816:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322769792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.982838:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322769792:12345-0@lo:400:kworker.0 Request processed in 22us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264211.982843:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789264211.982851:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789264211.982855:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322769024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.983016:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322769024:12345-0@lo:400:kworker.0 Request processed in 159us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264211.983023:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789264211.983052:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322768768:0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.983061:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322769280:0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.983083:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322769792:0@lo:400:kworker.0 00000100:00080000:1.0:1789264211.983103:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264211.983118:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322769024:0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.983138:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264211.983160:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322769920:0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.983184:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264211.983291:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322768896:0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.983308:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322769408 00000100:00100000:1.0:1789264211.983311:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322769408 00000100:00100000:1.0:1789264211.983417:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322769920 00000100:00100000:1.0:1789264211.983421:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322769920 00000100:00100000:1.0:1789264211.983436:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789264211.983442:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322769408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.983477:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322769408:12345-0@lo:400:kworker.0 Request processed in 35us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264211.983482:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789264211.983494:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789264211.983499:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322769920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.983525:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322769920:12345-0@lo:400:kworker.0 Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264211.983531:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:1.0:1789264211.983544:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789264211.983563:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c8a300 x1876179322769408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264211.983573:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322769408:0@lo:400:kworker.0 00010000:00080000:1.0:1789264211.983593:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abab41f80 x1876179322769920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264211.983601:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322769920:0@lo:400:kworker.0 00000100:00100000:0.0:1789264211.983919:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322769152:0@lo:400:kworker.0 00000100:00100000:0.0:1789264211.983952:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264211.983962:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322768640 00000100:00100000:1.0:1789264211.983968:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322768640 00000100:00100000:0.0:1789264211.983982:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322769664:0@lo:400:kworker.0 00000100:00100000:1.0:1789264211.983999:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789264211.984009:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322768640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264211.984015:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264211.984062:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322768640:12345-0@lo:400:kworker.0 Request processed in 55us (3179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264211.984071:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1789264211.984097:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322768640:0@lo:400:kworker.0 00000100:00100000:3.0:1789264211.984572:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322769152 00000100:00100000:3.0:1789264211.984581:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322769152 00000100:00100000:3.0:1789264211.984637:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789264211.984648:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322769152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264211.984717:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322769152:12345-0@lo:400:kworker.0 Request processed in 73us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264211.984724:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789264211.984848:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322769152:0@lo:400:kworker.0 00000100:00100000:2.0:1789264211.986834:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322769664 00000100:00100000:2.0:1789264211.986846:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322769664 00000100:00100000:2.0:1789264211.986986:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789264211.986998:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322769664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264211.987087:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322769664:12345-0@lo:400:kworker.0 Request processed in 92us (3076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264211.987094:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1789264211.987180:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c37b80 x1876179322769664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264211.987194:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322769664:0@lo:400:kworker.0 00000100:00080000:1.0:1789264211.988019:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264212.490320:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322770048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789264212.490387:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264212.490619:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322770048 00000100:00100000:3.0:1789264212.490627:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322770048 00000100:00100000:3.0:1789264212.490682:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789264212.490702:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322770048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789264212.490733:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789264212.490809:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322770048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264212.490816:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789264212.490982:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322770048:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789264212.618576:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264212.944529:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264212.944585:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264212.944631:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264212.944673:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264212.944681:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311160192 00000100:00100000:2.0:1789264212.944698:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311160192 00000100:00100000:0.0:1789264212.944721:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264212.944723:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311160448 00000100:00100000:1.0:1789264212.944730:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311160448 00000100:00100000:3.0:1789264212.944849:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311160704 00000100:00100000:3.0:1789264212.944858:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311160704 00000100:00100000:3.0:1789264212.944941:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311160320 00000100:00100000:3.0:1789264212.944944:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311160320 00000100:00100000:3.0:1789264212.944959:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311160576 00000100:00100000:3.0:1789264212.944961:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311160576 00000100:00100000:3.0:1789264212.944981:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 184 00000100:00100000:3.0:1789264212.944993:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311160704:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264212.948347:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311160704:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 3335us (3694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264212.948368:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 184 00000100:00100000:3.0:1789264212.948416:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 185 00000100:00100000:3.0:1789264212.948436:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311160320:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264212.948531:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311160320:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 108us (3858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264212.948556:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 186 00000100:00100000:3.0:1789264212.948575:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 185 00000100:00100000:0.0:1789264212.948586:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311160576:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264212.948597:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 187 00000100:00100000:3.0:1789264212.948620:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311160448:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264212.948636:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311160576:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 62us (3917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264212.948644:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 186 00000100:00100000:3.0:1789264212.948657:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311160448:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 50us (4069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264212.948665:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 187 00000100:00080000:3.0:1789264212.948702:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789264212.948710:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789264212.951705:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 357 00000100:00100000:2.0:1789264212.951736:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2405:x1876179311160192:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264212.952466:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2405:x1876179311160192:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 743us (7950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264212.952476:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 357 00000001:00100000:3.0:1789264213.517906:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 92638a4f-1391-4305-a4ab-5961bcacc46a 00000020:00000080:3.0:1789264213.517916:0:9482:0:(genops.c:885:class_export_put()) final put ffff9c3983e58800/92638a4f-1391-4305-a4ab-5961bcacc46a 00000020:00000080:1.0:1789264213.517982:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3983e58800/92638a4f-1391-4305-a4ab-5961bcacc46a for lustre-OST0001 00000020:00000080:1.0:1789264213.518035:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3983e5f000 for lustre-OST0001 00010000:00010000:2.0:1789264213.651661:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264214.537976:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322770176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789264214.538053:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264214.538147:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322770176 00000100:00100000:0.0:1789264214.538155:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322770176 00000100:00100000:2.0:1789264214.538202:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322770304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789264214.538238:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789264214.538250:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264214.538252:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322770176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789264214.538284:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264214.538292:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322770304 00000100:00100000:2.0:1789264214.538298:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322770304 00000100:00100000:2.0:1789264214.538325:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789264214.538337:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322770304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789264214.538348:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264214.538381:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322770304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264214.538388:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1789264214.538423:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abf56c700 x1876179322770304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264214.538441:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322770304:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789264214.538472:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264214.542295:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322770176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4038us (4231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264214.542311:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1789264214.543356:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39837f1f80 x1876179322770176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264214.543382:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322770176:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789264214.669381:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264215.060664:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322770432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789264215.060736:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264215.060838:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322770432 00000100:00100000:0.0:1789264215.060847:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322770432 00000100:00100000:0.0:1789264215.060902:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789264215.060912:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322770432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789264215.060946:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789264215.062100:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322770432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1186us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264215.062110:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789264215.062264:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322770432:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789264215.691048:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789264215.757097:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789264215.757493:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789264216.714078:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264217.098341:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322770560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264217.098411:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264217.098508:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322770560 00000100:00100000:1.0:1789264217.098516:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322770560 00000100:00100000:1.0:1789264217.098591:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789264217.098603:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322770560:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789264217.098646:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322770688:0@lo:400:kworker.0 00002000:00000024:1.0:1789264217.098646:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264217.098695:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264217.098703:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322770560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264217.098712:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1789264217.098734:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789264217.098764:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322770944:0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.098792:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264217.098819:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322770944 00000100:00100000:1.0:1789264217.098822:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322770944 00000100:00100000:1.0:1789264217.098856:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789264217.098862:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322770944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.098899:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322770944:12345-0@lo:400:kworker.0 Request processed in 37us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264217.098905:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789264217.098930:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322771072:0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.098955:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264217.098977:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322771072 00000100:00100000:1.0:1789264217.098981:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322771072 00000100:00100000:1.0:1789264217.099007:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789264217.099014:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322771072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.099047:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322771072:12345-0@lo:400:kworker.0 Request processed in 34us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264217.099053:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789264217.099084:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322770688 00000100:00100000:1.0:1789264217.099087:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322770688 00000100:00100000:1.0:1789264217.099110:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789264217.099116:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322770688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.099154:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322770688:12345-0@lo:400:kworker.0 Request processed in 37us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264217.099160:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1789264217.099537:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322770816:0@lo:400:kworker.0 00000100:00100000:2.0:1789264217.099575:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264217.099628:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322770816 00000100:00100000:2.0:1789264217.099633:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322770816 00000100:00100000:2.0:1789264217.099663:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789264217.099670:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322770816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264217.099708:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322770816:12345-0@lo:400:kworker.0 Request processed in 38us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264217.099716:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789264217.105966:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322770688:0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.106288:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322770944:0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.106300:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322771456:0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.106551:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264217.106602:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322771968:0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.106624:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264217.106884:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322771200:0@lo:400:kworker.0 00000100:00100000:3.0:1789264217.106917:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264217.106941:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322771712:0@lo:400:kworker.0 00000100:00100000:3.0:1789264217.106967:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264217.107092:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322770816:0@lo:400:kworker.0 00000100:00100000:3.0:1789264217.107217:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322772224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264217.107245:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264217.107304:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322771456 00000100:00100000:1.0:1789264217.107304:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322771968 00000100:00100000:1.0:1789264217.107312:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322771968 00000100:00100000:3.0:1789264217.107313:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322771456 00000100:00100000:1.0:1789264217.107423:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789264217.107517:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322771968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.107572:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322771968:12345-0@lo:400:kworker.0 Request processed in 60us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264217.107591:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:1.0:1789264217.107613:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789264217.107917:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322771328:0@lo:400:kworker.0 00000100:00100000:2.0:1789264217.107946:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264217.107968:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322771840:0@lo:400:kworker.0 00000100:00100000:2.0:1789264217.108069:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264217.108262:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322771072:0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.108271:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322771584:0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.108301:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264217.108387:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322772096:0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.108410:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264217.108477:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322771712 00000100:00100000:2.0:1789264217.108483:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322771712 00000100:00100000:2.0:1789264217.108520:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322771584 00000100:00100000:2.0:1789264217.108523:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322771584 00000100:00100000:2.0:1789264217.108542:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322772096 00000100:00100000:2.0:1789264217.108545:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322772096 00000100:00100000:2.0:1789264217.108561:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789264217.108568:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322771712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.108699:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322770560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264217.108738:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789264217.108764:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322771584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264217.108847:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322771328 00000100:00100000:3.0:1789264217.108851:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322771328 00000100:00100000:3.0:1789264217.108873:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322771840 00000100:00100000:3.0:1789264217.108875:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322771840 00000100:00100000:3.0:1789264217.108895:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789264217.108902:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322771456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264217.113852:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322771712:12345-0@lo:400:kworker.0 Request processed in 5274us (6874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264217.113867:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789264217.113900:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789264217.113913:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322772096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264217.113993:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322772096:12345-0@lo:400:kworker.0 Request processed in 86us (5582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264217.114000:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1789264217.114030:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789264217.114035:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789264217.114039:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789264217.114052:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789264217.114060:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322771328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264217.114113:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322771328:12345-0@lo:400:kworker.0 Request processed in 40us (6152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264217.114120:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789264217.114136:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789264217.114142:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322771840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264217.114170:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322771840:12345-0@lo:400:kworker.0 Request processed in 28us (6101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264217.114176:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789264217.114233:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322772096:0@lo:400:kworker.0 00000100:00100000:2.0:1789264217.114266:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322771328:0@lo:400:kworker.0 00000100:00100000:2.0:1789264217.114277:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322771840:0@lo:400:kworker.0 00000100:00100000:2.0:1789264217.114321:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322772224 00000100:00100000:2.0:1789264217.114328:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322772224 00000100:00100000:2.0:1789264217.115409:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789264217.115422:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322772224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789264217.115444:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264217.115492:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322772224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (8247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264217.115509:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789264217.115537:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322771200 00000100:00100000:2.0:1789264217.115542:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322771200 00000100:00100000:2.0:1789264217.115587:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789264217.115594:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322771200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264217.115628:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322771200:12345-0@lo:400:kworker.0 Request processed in 34us (8710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264217.115634:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789264217.115693:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322772224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264217.115705:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322771200:0@lo:400:kworker.0 00010000:00080000:2.0:1789264217.115717:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836e2300 x1876179322771712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264217.115728:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322771712:0@lo:400:kworker.0 00010000:00080000:2.0:1789264217.115790:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836e0000 x1876179322771968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264217.115870:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322771968:0@lo:400:kworker.0 00000100:00100000:1.0:1789264217.119853:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322771584:12345-0@lo:400:kworker.0 Request processed in 11098us (11540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264217.119868:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1789264217.119931:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836e0e00 x1876179322771584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789264233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264217.119947:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322771584:0@lo:400:kworker.0 00000100:00100000:3.0:1789264217.120616:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322771456:12345-0@lo:400:kworker.0 Request processed in 11711us (14062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264217.120625:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00010000:00080000:2.0:1789264217.120701:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39836e3b80 x1876179322771456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264217.120713:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322771456:0@lo:400:kworker.0 00000100:00100000:2.0:1789264217.615592:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789264217.615616:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322772352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789264217.615682:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264217.615741:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322772352 00000100:00100000:2.0:1789264217.615761:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322772352 00000100:00100000:2.0:1789264217.615811:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789264217.615820:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322772352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789264217.615850:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789264217.615893:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322772352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264217.615900:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789264217.615944:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322772352:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789264217.739282:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789264217.742361:0:14020:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:50:16 (1789264216) 00000100:00100000:0.0:1789264218.061379:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264218.061418:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264218.061450:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264218.061471:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264218.061489:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264218.061591:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311161088 00000100:00100000:1.0:1789264218.061601:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311161088 00000100:00100000:3.0:1789264218.061610:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311161344 00000100:00100000:3.0:1789264218.061616:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311161344 00000100:00100000:1.0:1789264218.061713:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311160960 00000100:00100000:1.0:1789264218.061718:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311160960 00000100:00100000:2.0:1789264218.061780:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311160832 00000100:00100000:2.0:1789264218.061786:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311160832 00000100:00100000:2.0:1789264218.061819:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 359 00000100:00100000:2.0:1789264218.061828:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2404:x1876179311160832:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264218.061894:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2404:x1876179311160832:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 66us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264218.061902:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 359 00000100:00100000:2.0:1789264218.061932:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311161216 00000100:00100000:2.0:1789264218.061936:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311161216 00000100:00100000:3.0:1789264218.064083:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 194 00000100:00100000:3.0:1789264218.064098:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311161088:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264218.064234:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311161088:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 71us (2745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264218.064244:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 194 00000100:00100000:3.0:1789264218.064264:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 195 00000100:00100000:3.0:1789264218.064272:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311161344:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264218.064300:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311161344:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 30us (2849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264218.064306:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 195 00000100:00080000:0.0:1789264218.072053:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789264218.072385:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789264218.072728:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 196 00000100:00100000:1.0:1789264218.072759:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311160960:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264218.072841:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311160960:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 103us (11368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264218.072848:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 196 00000100:00100000:2.0:1789264218.076585:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 197 00000100:00100000:2.0:1789264218.076603:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311161216:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264218.076686:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311161216:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 87us (15194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264218.076705:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 197 00010000:00010000:2.0:1789264218.764708:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264219.262552:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264219.262659:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311161472 00000100:00100000:3.0:1789264219.262684:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311161472 00000100:00100000:3.0:1789264219.263032:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:3.0:1789264219.263047:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:11054:x1876179311161472:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789264219.263066:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264219.263098:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ec5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa7c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264219.263165:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed6ecc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264219.263179:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed6ecc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264219.263192:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed6ecc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264219.263239:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789264219.263242:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264219.263280:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed6ecc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264219.263303:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6ec5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa7c expref: 7 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264219.263320:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed6ecc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa7c expref: 6 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264219.264454:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983361900) 00010000:00010000:3.0:1789264219.264460:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789264219.264464:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a800, rc 0) 00000100:00100000:3.0:1789264219.264547:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:11054:x1876179311161472:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1503us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264219.264556:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:1.0:1789264219.272486:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264219.272599:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311161600 00000100:00100000:0.0:1789264219.272628:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311161600 00000100:00100000:0.0:1789264219.272686:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:0.0:1789264219.272696:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:11055:x1876179311161600:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264219.272713:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264219.272733:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed6ed3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa83 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.272824:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed6eda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.272846:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed6eda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.272856:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed6eda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.272870:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed6ee1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.272876:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed6ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.272882:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed6ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.272932:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b800/0xecaf9f2f14ed6ee8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.272939:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b800/0xecaf9f2f14ed6ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.272946:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b800/0xecaf9f2f14ed6ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264219.273318:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789264219.273323:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789264219.273420:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b800/0xecaf9f2f14ed6ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273432:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed6eda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273439:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed6eda lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273446:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed6eda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273452:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366a000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264219.273456:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed6eda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273463:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed6eda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273474:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983361900) 00010000:00010000:0.0:1789264219.273477:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264219.273482:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed6eda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273487:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed6eda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273500:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed6ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273516:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed6ee1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273522:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed6ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273527:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264219.273530:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed6ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273536:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed6ee1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273544:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c39824a1b00) 00010000:00010000:0.0:1789264219.273547:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264219.273550:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed6ee1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273556:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed6ee1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273694:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed6ed3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa83 expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273707:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b800/0xecaf9f2f14ed6ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa83 expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264219.273714:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c39824a1300) 00010000:00010000:0.0:1789264219.273716:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789264219.273725:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366b800, rc 0) 00000100:00100000:0.0:1789264219.274207:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:11055:x1876179311161600:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1510us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264219.274215:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:3.0:1789264219.277493:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264219.277609:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311161728 00000100:00100000:0.0:1789264219.277619:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311161728 00000100:00100000:0.0:1789264219.277676:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:0.0:1789264219.277687:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:92638a4f-1391-4305-a4ab-5961bcacc46a+7:11055:x1876179311161728:12345-192.168.203.44@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789264219.277794:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:92638a4f-1391-4305-a4ab-5961bcacc46a+7:11055:x1876179311161728:12345-192.168.203.44@tcp:900:lhsmtool_posix.0 Request processed in 109us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264219.277802:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:3.0:1789264219.281341:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264219.281584:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311161984 00000100:00100000:2.0:1789264219.281595:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311161984 00000100:00100000:2.0:1789264219.281691:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:2.0:1789264219.281701:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+7:11055:x1876179311161984:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789264219.281719:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264219.281739:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622e00/0xecaf9f2f14ed6eef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa8a expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.281825:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6ef6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.281839:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6ef6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.281848:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6ef6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.281898:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6efd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.281906:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6efd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.281914:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6efd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282026:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623000/0xecaf9f2f14ed6f04 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282062:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623000/0xecaf9f2f14ed6f04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282070:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623000/0xecaf9f2f14ed6f04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264219.282081:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789264219.282173:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6ef6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282181:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6ef6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282188:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6ef6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282194:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264219.282198:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6ef6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282205:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6ef6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282218:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c39824a1300) 00010000:00010000:2.0:1789264219.282221:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264219.282226:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6ef6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282232:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6ef6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282245:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6efd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282258:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6efd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282264:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6efd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282269:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264219.282273:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6efd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282279:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6efd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282288:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c3ab7e7c500) 00010000:00010000:2.0:1789264219.282291:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264219.282294:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6efd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282300:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6efd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282555:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622e00/0xecaf9f2f14ed6eef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa8a expref: 10 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282581:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623000/0xecaf9f2f14ed6f04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa8a expref: 9 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264219.282588:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e7c300) 00010000:00010000:2.0:1789264219.282590:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264219.282597:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623000, rc 0) 00000100:00100000:2.0:1789264219.283291:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+9:11055:x1876179311161984:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1589us (1956us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789264219.283300:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:3.0:1789264219.289069:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264219.289236:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311162112 00000100:00100000:2.0:1789264219.289250:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311162112 00000100:00100000:2.0:1789264219.289320:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:2.0:1789264219.289330:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+9:11055:x1876179311162112:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789264219.289446:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+9:11055:x1876179311162112:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 Request processed in 112us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264219.289458:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:3.0:1789264219.294653:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264219.294839:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311162240 00000100:00100000:0.0:1789264219.294849:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311162240 00000100:00100000:0.0:1789264219.294909:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:0.0:1789264219.294919:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:11055:x1876179311162240:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1789264219.295881:0:6490:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 919us 00000100:00100000:1.0:1789264219.311107:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:11055:x1876179311162240:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 Request processed in 16179us (16451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264219.311122:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:2.0:1789264219.658308:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322772480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789264219.658308:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322772608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789264219.658385:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264219.658426:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322772480 00000100:00100000:1.0:1789264219.658434:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322772480 00000100:00100000:1.0:1789264219.658497:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789264219.658509:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322772480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789264219.658538:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789264219.658553:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264219.658613:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322772480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264219.658622:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1789264219.658657:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3abf56d180 x1876179322772480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264219.658677:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abf56d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322772480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789264219.658683:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264219.658785:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322772608 00000100:00100000:1.0:1789264219.658800:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322772608 00000100:00100000:1.0:1789264219.658840:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1789264219.658845:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264219.658849:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322772608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789264219.658860:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264219.658894:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322772608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264219.658900:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1789264219.659156:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39837f1880 x1876179322772608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264219.659169:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322772608:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789264219.786874:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789264219.853548:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789264219.856950:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789264220.169959:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322772736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789264220.170062:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264220.170313:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322772736 00000100:00100000:0.0:1789264220.170321:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322772736 00000100:00100000:0.0:1789264220.170384:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789264220.170394:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322772736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789264220.170440:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789264220.170500:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322772736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264220.170507:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789264220.170646:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39837f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322772736:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789264220.813017:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264221.037996:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264221.038998:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311162368 00000100:00100000:2.0:1789264221.039009:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311162368 00000100:00080000:1.0:1789264221.039099:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264221.039138:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:2.0:1789264221.039158:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+9:11096:x1876179311162368:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264221.039177:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264221.039195:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6f12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa91 expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039268:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6f19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039282:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6f19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039293:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6f19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039307:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6f20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039313:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6f20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039318:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6f20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039359:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6f19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039366:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6f19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039373:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6f19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039379:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622a00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264221.039384:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6f19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039401:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6f19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039414:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983361900) 00010000:00010000:2.0:1789264221.039416:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264221.039421:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6f19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039427:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6f19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039438:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6f20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039444:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6f20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039449:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6f20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039454:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264221.039457:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6f20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039463:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6f20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039470:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c3ab7e7de00) 00010000:00010000:2.0:1789264221.039472:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264221.039475:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6f20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039491:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6f20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039526:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6f12 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa91 expref: 10 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039536:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983361900) 00010000:00010000:2.0:1789264221.039539:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264221.039542:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6f12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa91 expref: 10 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.039561:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622600, rc 0) 00000100:00100000:2.0:1789264221.039629:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+9:11096:x1876179311162368:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 483us (1641us total) trans 0 rc 301/301 00000100:00100000:2.0:1789264221.039637:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:2.0:1789264221.052342:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264221.052402:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311162624 00000100:00100000:3.0:1789264221.052413:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311162624 00000100:00100000:3.0:1789264221.052469:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:3.0:1789264221.052479:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+9:11096:x1876179311162624:12345-192.168.203.44@tcp:36:lfs.0 00010000:00010000:3.0:1789264221.052528:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264221.052560:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed6ecc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa7c expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.052578:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983361900) 00010000:00010000:3.0:1789264221.052587:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789264221.052641:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6f27 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.052652:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6f27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.052661:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6f27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.052687:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6f2e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.052694:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6f2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.052701:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6f2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.053110:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6f35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.053119:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6f35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.053127:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6f35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789264221.053142:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076d5e263 reply state 00000000fdc2d8f0 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6f35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.053165:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6f35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.053171:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:3.0:1789264221.053174:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789264221.053176:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789264221.053180:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789264221.053187:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6f27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.053193:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6f27 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.053207:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6f27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.053212:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36ac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264221.053216:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6f27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.053223:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6f27 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.053232:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983364500) 00010000:00010000:3.0:1789264221.053234:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264221.053238:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6f27 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.053243:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed6f27 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789264221.053258:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076d5e263 reply state 00000000fdc2d8f0 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6f2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.053267:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6f2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.053277:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c3983364f00) 00010000:00010000:3.0:1789264221.053279:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789264221.053281:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789264221.053373:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+10:11096:x1876179311162624:12345-192.168.203.44@tcp:36:lfs.0 Request processed in 894us (1038us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789264221.053380:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:1.0:1789264221.166160:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264221.166221:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311162752 00000100:00100000:0.0:1789264221.166231:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311162752 00000100:00100000:0.0:1789264221.166297:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:0.0:1789264221.166307:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+10:11105:x1876179311162752:12345-192.168.203.44@tcp:101:lctl.0 00010000:00010000:0.0:1789264221.166339:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264221.166361:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed6f3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa98 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.166421:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed6f43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.166434:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed6f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.166445:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed6f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264221.166484:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789264221.166488:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789264221.166523:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed6f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.166548:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed6f3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa98 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.166591:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed6f43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa98 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.166599:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c39824a1a00) 00010000:00010000:0.0:1789264221.166601:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789264221.166605:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366ba00, rc 0) 00000100:00100000:0.0:1789264221.166667:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+11:11105:x1876179311162752:12345-192.168.203.44@tcp:101:lctl.0 Request processed in 362us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264221.166675:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:3.0:1789264221.205924:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264221.206041:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311162880 00000100:00100000:2.0:1789264221.206051:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311162880 00000100:00100000:2.0:1789264221.206203:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:2.0:1789264221.206215:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+11:11111:x1876179311162880:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1789264221.206234:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264221.206253:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6f4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaa9f expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206315:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6f51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206356:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6f51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206367:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6f51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206379:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6f58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206386:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206392:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206462:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622e00/0xecaf9f2f14ed6f5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206469:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622e00/0xecaf9f2f14ed6f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206476:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622e00/0xecaf9f2f14ed6f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264221.206505:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789264221.206508:0:7904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264221.206543:0:7904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622e00/0xecaf9f2f14ed6f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206566:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6f51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206581:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6f51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206587:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6f51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206593:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5623400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264221.206598:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6f51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206604:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6f51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206616:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c39824a1a00) 00010000:00010000:2.0:1789264221.206619:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264221.206623:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6f51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206629:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6f51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206642:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206647:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6f58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206653:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6f58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206657:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264221.206666:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6f58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206672:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6f58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206679:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c3983364f00) 00010000:00010000:2.0:1789264221.206681:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264221.206684:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6f58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206689:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6f58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206714:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed6f4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa9f expref: 13 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206726:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622e00/0xecaf9f2f14ed6f5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa9f expref: 12 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.206734:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:2.0:1789264221.206736:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789264221.206738:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622e00, rc 0) 00000100:00100000:2.0:1789264221.207077:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+12:11111:x1876179311162880:12345-192.168.203.44@tcp:101:bash.0 Request processed in 863us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264221.207085:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:2.0:1789264221.210489:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264221.210608:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311163136 00000100:00100000:1.0:1789264221.210617:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311163136 00000100:00100000:1.0:1789264221.210714:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 48 00000100:00100000:1.0:1789264221.210725:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+12:11111:x1876179311163136:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:1.0:1789264221.210770:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264221.210790:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed6f66 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaaa6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.210891:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed6f6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.210904:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed6f6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.210915:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed6f6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.210957:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed6f74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.210981:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed6f74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.210988:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed6f74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789264221.211344:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789264221.211466:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed6f7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.211475:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed6f7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.211483:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed6f7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.211514:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed6f6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.211522:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed6f6d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.211529:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed6f6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.211536:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45e00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264221.211540:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed6f6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.211548:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed6f6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.211583:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:1.0:1789264221.211586:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789264221.211591:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed6f6d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.211597:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed6f6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789264221.211609:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023e6e879 reply state 0000000018f51e49 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed6f74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.211619:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed6f74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.211624:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3ab7dca700) 00010000:00010000:1.0:1789264221.211626:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789264221.211629:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789264221.211655:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed6f66 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaa6 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.211669:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed6f7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaa6 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.211676:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7dca800) 00010000:00010000:1.0:1789264221.211678:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789264221.211680:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45a00, rc 0) 00000100:00100000:1.0:1789264221.211884:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+15:11111:x1876179311163136:12345-192.168.203.44@tcp:101:bash.0 Request processed in 1160us (1404us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789264221.211892:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 48 00000100:00100000:0.0:1789264221.218466:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264221.218538:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311163264 00000100:00100000:2.0:1789264221.218547:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311163264 00000100:00100000:2.0:1789264221.218604:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:2.0:1789264221.218625:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1876179311163264:12345-192.168.203.44@tcp:8:bash.0 00010000:00080000:2.0:1789264221.218655:0:8406:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:2.0:1789264221.218684:0:8406:0:(genops.c:1385:class_connect()) connect: client 92638a4f-1391-4305-a4ab-5961bcacc46a, cookie 0xecaf9f2f14ed6f89 00002000:00100000:2.0:1789264221.218696:0:8406:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 92638a4f-1391-4305-a4ab-5961bcacc46a/ffff9c3a88d17800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789264221.218713:0:8406:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789264221.218802:0:8406:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789264221.218828:0:8406:0:(import.c:65:import_set_state_nolock()) ffff9c3a88d17000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789264221.218894:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2401:x1876179311163264:12345-192.168.203.44@tcp:8:bash.0 Request processed in 270us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264221.218901:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:3.0:1789264221.220835:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264221.220927:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311163392 00000100:00100000:2.0:1789264221.220936:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311163392 00000100:00100000:2.0:1789264221.221008:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:2.0:1789264221.221018:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:0:x1876179311163392:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1789264221.221032:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264221.221053:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025e15a98/0xecaf9f2f14ed6f90 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaaad expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789264221.221077:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789264221.221093:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1789264221.221098:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264221.221107:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025e15a98/0xecaf9f2f14ed6f90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaad expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.221126:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025e15a98/0xecaf9f2f14ed6f90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaad expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.221162:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622a00, rc 0) 00000100:00100000:2.0:1789264221.221205:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+7:0:x1876179311163392:12345-192.168.203.44@tcp:101:bash.0 Request processed in 188us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264221.221212:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00080000:1.0:1789264221.221693:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264221.223484:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264221.223561:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311163520 00000100:00100000:1.0:1789264221.223570:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311163520 00000100:00100000:1.0:1789264221.223625:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:1.0:1789264221.223634:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+7:11111:x1876179311163520:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:1.0:1789264221.223649:0:10317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264221.223666:0:10317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaab4 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.223692:0:10317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025e15a98/0xecaf9f2f14ed6f90 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaad expref: 8 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.223699:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264221.223703:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264221.223707:0:10317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 8 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.223740:0:10317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025e15a98/0xecaf9f2f14ed6f90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaad expref: 8 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.223786:0:10317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025e15a98/0xecaf9f2f14ed6f90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaad expref: 8 pid: 8405 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264221.223800:0:10317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10317:1876179322772864:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264221.223893:0:10317:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c22c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264221.226686:0:10317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10317:1876179322772864:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264221.226736:0:10317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 8 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.226788:0:10317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44e00, rc 0) 00000100:00100000:1.0:1789264221.226833:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+8:11111:x1876179311163520:12345-192.168.203.44@tcp:101:bash.0 Request processed in 3201us (3356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264221.226841:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:0.0:1789264221.227726:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264221.227994:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311163648 00000100:00100000:3.0:1789264221.228002:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311163648 00010000:00010000:3.0:1789264221.228035:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025e15a98/0xecaf9f2f14ed6f90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaad expref: 8 pid: 8405 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264221.228073:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:3.0:1789264221.228083:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311163648:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264221.228107:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264221.228127:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025e15a98/0xecaf9f2f14ed6f90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaad expref: 8 pid: 8405 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.228140:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025e15a98/0xecaf9f2f14ed6f90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaad expref: 8 pid: 8405 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.228262:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025e15a98/0xecaf9f2f14ed6f90 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaad expref: 8 pid: 8405 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.228278:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264221.228282:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264221.228289:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 7 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.228299:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 7 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.228361:0:8420:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 7 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264221.228375:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c60380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8420:1876179322772992:192.168.203.44@tcp:105: 00000100:00100000:3.0:1789264221.228480:0:8420:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398307b180 going to sleep for 11 seconds 00000100:00100000:3.0:1789264221.232018:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c60380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8420:1876179322772992:192.168.203.44@tcp:105: 00010000:00010000:3.0:1789264221.232044:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264221.232107:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2402:x1876179311163648:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 4024us (4383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264221.232117:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:1.0:1789264221.233961:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264221.234049:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311163904 00000100:00100000:2.0:1789264221.234057:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311163904 00000100:00100000:2.0:1789264221.234112:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:2.0:1789264221.234122:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+15:11111:x1876179311163904:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:2.0:1789264221.234419:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+16:11111:x1876179311163904:12345-192.168.203.44@tcp:35:bash.0 Request processed in 297us (464us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789264221.234426:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:0.0:1789264221.313703:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264221.313821:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311164160 00000100:00100000:1.0:1789264221.313830:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311164160 00000100:00100000:1.0:1789264221.313882:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 49 00000100:00100000:1.0:1789264221.313891:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+16:11121:x1876179311164160:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1789264221.313911:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264221.313927:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed6f9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaabb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264221.314023:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789264221.314127:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed6f9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaabb expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.314140:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c39824a1a00) 00010000:00010000:1.0:1789264221.314158:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789264221.314164:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed6f9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaabb expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.314177:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44200, rc 0) 00000100:00100000:1.0:1789264221.314239:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+17:11121:x1876179311164160:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 348us (543us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1789264221.314259:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 49 00000100:00100000:3.0:1789264221.317704:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264221.317842:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311164416 00000100:00100000:2.0:1789264221.317852:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311164416 00000100:00100000:2.0:1789264221.317910:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:2.0:1789264221.317919:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+17:11121:x1876179311164416:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:2.0:1789264221.318152:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+18:11121:x1876179311164416:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 225us (448us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789264221.318160:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:0.0:1789264221.406384:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264221.406485:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311164544 00000100:00100000:2.0:1789264221.406495:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311164544 00000100:00100000:2.0:1789264221.406561:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:2.0:1789264221.406570:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+18:11127:x1876179311164544:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264221.406590:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264221.406622:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6fac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaac2 expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.406686:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6fb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.406700:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.406724:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264221.406828:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789264221.406833:0:7904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264221.406852:0:7904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.406878:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6fac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaac2 expref: 20 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.406896:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaac2 expref: 19 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.406905:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:2.0:1789264221.406907:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789264221.406911:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623400, rc 0) 00000100:00100000:2.0:1789264221.406973:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+19:11127:x1876179311164544:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 404us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264221.406980:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:3.0:1789264221.414622:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264221.414799:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311164800 00000100:00100000:1.0:1789264221.414810:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311164800 00000100:00100000:1.0:1789264221.414887:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:1.0:1789264221.414898:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+19:11127:x1876179311164800:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1789264221.414919:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264221.414939:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed6fba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaac9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.415045:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed6fc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.415059:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed6fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.415071:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed6fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264221.415083:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789264221.415187:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed6fba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaac9 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.415207:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed6fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaac9 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.415216:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7dca800) 00010000:00010000:1.0:1789264221.415219:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789264221.415222:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44a00, rc 0) 00000100:00100000:1.0:1789264221.415299:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+21:11127:x1876179311164800:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 403us (686us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789264221.415306:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:3.0:1789264221.417806:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264221.417977:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311165056 00000100:00100000:2.0:1789264221.418001:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311165056 00000100:00100000:2.0:1789264221.418065:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:2.0:1789264221.418075:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+21:11127:x1876179311165056:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264221.418097:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264221.418117:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6fcf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaad0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.418228:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6fd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.418241:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.418253:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264221.418268:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789264221.418621:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed6fcf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaad0 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.418640:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6fd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaad0 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.418650:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7dca800) 00010000:00010000:2.0:1789264221.418652:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789264221.418656:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623200, rc 0) 00000100:00100000:2.0:1789264221.418718:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+23:11127:x1876179311165056:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 644us (923us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789264221.418725:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:2.0:1789264221.419973:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264221.420042:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311165184 00000100:00100000:3.0:1789264221.420050:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311165184 00000100:00100000:3.0:1789264221.420102:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:3.0:1789264221.420111:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+23:2402:x1876179311165184:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264221.420123:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264221.420287:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed6fc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaac9 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.420305:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7dca800) 00010000:00010000:3.0:1789264221.420309:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264221.420519:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+22:2402:x1876179311165184:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 408us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264221.420539:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:0.0:1789264221.431178:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264221.434066:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311165312 00000100:00100000:3.0:1789264221.434081:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311165312 00000100:00100000:2.0:1789264221.437046:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:2.0:1789264221.437061:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2405:x1876179311165312:12345-192.168.203.44@tcp:1:lfs.0 00010000:00010000:2.0:1789264221.437105:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034cd4339/0xecaf9f2f14ed6fe4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.437126:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 7 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.437135:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264221.437140:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789264221.437156:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034cd4339/0xecaf9f2f14ed6fe4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.437193:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 7 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.437494:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 7 pid: 10317 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264221.437511:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8403:1876179322773120:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264221.437615:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52300 going to sleep for 11 seconds 00000100:00100000:1.0:1789264221.450581:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264221.450740:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311165440 00000100:00100000:0.0:1789264221.450778:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311165440 00002000:00100000:0.0:1789264221.450826:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9c39836e0e00 x1876179311165440/t0(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:302/0 lens 504/0 e 0 to 0 dl 1789264232 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789264221.450836:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c39836e0e00 with x1876179311165440 ext(0->12) 00010000:00010000:0.0:1789264221.450844:0:8409:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 8 pid: 10317 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.450870:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 8 pid: 10317 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789264221.450896:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c39836e0e00 00000100:00100000:0.0:1789264221.450926:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:0.0:1789264221.450935:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2403:x1876179311165440:12345-192.168.203.44@tcp:4:lfs.0 00000100:00100000:2.0:1789264221.452495:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8403:1876179322773120:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264221.452528:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000034cd4339/0xecaf9f2f14ed6fe4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1789264221.452925:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 92638a4f-1391-4305-a4ab-5961bcacc46a 00000100:00100000:0.0:1789264221.454126:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2403:x1876179311165440:12345-192.168.203.44@tcp:4:lfs.0 Request processed in 3186us (3550us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789264221.454139:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 0 00002000:00100000:0.0:1789264221.454164:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9c39836e0e00 x1876179311165440/t4294967300(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:302/0 lens 504/448 e 0 to 0 dl 1789264232 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789264221.454175:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c39836e0e00 with x1876179311165440 ext(0->12) 00010000:00010000:0.0:1789264221.454185:0:8409:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 9 pid: 10317 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.454215:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 9 pid: 10317 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789264221.454224:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c39836e0e00 00000100:00100000:0.0:1789264221.457921:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264221.458085:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311165568 00000100:00100000:3.0:1789264221.458095:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311165568 00010000:00010000:3.0:1789264221.458133:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 9 pid: 10317 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264221.458182:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:3.0:1789264221.458191:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2402:x1876179311165568:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264221.458207:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789264221.458224:0:6477:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789264221.458226:0:6477:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789264221 00002000:00010000:3.0:1789264221.458229:0:6477:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789264221 00002000:00010000:3.0:1789264221.458230:0:6477:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789264221 00002000:00010000:3.0:1789264221.458232:0:6477:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789264221.458238:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 9 pid: 10317 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.458266:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 9 pid: 10317 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.458289:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed6f97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaab4 expref: 9 pid: 10317 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.458708:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789264221.458713:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789264221.458720:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000034cd4339/0xecaf9f2f14ed6fe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.458730:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034cd4339/0xecaf9f2f14ed6fe4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.458819:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264221.458880:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311165568:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 689us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264221.458888:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 53 00010000:00010000:1.0:1789264221.459257:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000034cd4339/0xecaf9f2f14ed6fe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.459268:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034cd4339/0xecaf9f2f14ed6fe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.459293:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034cd4339/0xecaf9f2f14ed6fe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.459300:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034cd4339/0xecaf9f2f14ed6fe4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.459483:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034cd4339/0xecaf9f2f14ed6fe4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.459493:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622200 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264221.459498:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034cd4339/0xecaf9f2f14ed6fe4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.459507:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034cd4339/0xecaf9f2f14ed6fe4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.459525:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034cd4339/0xecaf9f2f14ed6fe4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.459543:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034cd4339/0xecaf9f2f14ed6fe4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264221.459616:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2405:x1876179311165312:12345-192.168.203.44@tcp:1:lfs.0 Request processed in 22560us (28448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264221.459625:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:1.0:1789264221.463078:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264221.463152:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311165824 00000100:00100000:2.0:1789264221.463163:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311165824 00000100:00100000:2.0:1789264221.463208:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:2.0:1789264221.463218:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+22:11127:x1876179311165824:12345-192.168.203.44@tcp:35:lfs.0 00000004:00010000:2.0:1789264221.463288:0:6494:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6fd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaad0 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789264221.463726:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1789264221.463810:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789264221.465644:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1789264221.465705:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.465724:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed6f7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaa6 expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.465733:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.465804:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed6f7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaa6 expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.465822:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed6f7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaa6 expref: 26 pid: 6492 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264221.465837:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1876179322773248:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264221.466457:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52300 going to sleep for 11 seconds 00000100:00100000:2.0:1789264221.468914:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1876179322773248:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264221.468944:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264221.469392:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264221.469793:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311165952 00000100:00100000:3.0:1789264221.469808:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311165952 00010000:00010000:3.0:1789264221.470067:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed6f7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaa6 expref: 27 pid: 6492 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264221.470337:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:2.0:1789264221.470350:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+27:2402:x1876179311165952:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264221.470366:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264221.470374:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed6f7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaa6 expref: 27 pid: 6492 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.470387:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed6f7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaa6 expref: 27 pid: 6492 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.470421:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed6f7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaa6 expref: 27 pid: 6492 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.470438:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7dca800) 00010000:00010000:2.0:1789264221.470451:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.470460:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.470468:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.470500:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789264221.470600:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.470608:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789264221.470715:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1789264221.470883:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1789264221.470976:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876179322773376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789264221.471027:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264221.475934:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+28:2402:x1876179311165952:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 5576us (6533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264221.475969:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:1.0:1789264221.476661:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c22f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264221.476714:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322773376 00000100:00100000:0.0:1789264221.476722:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322773376 00000100:00100000:0.0:1789264221.476805:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789264221.476814:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6494:x1876179322773376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1789264221.476943:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264221.477099:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6494:x1876179322773376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 285us (6072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264221.477117:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789264221.481603:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876179322773376:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789264221.482390:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1789264221.482464:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876179322773504:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789264221.482521:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264221.482619:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c22d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789264221.486980:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322773504 00000100:00100000:0.0:1789264221.486993:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322773504 00000100:00100000:0.0:1789264221.487125:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789264221.487137:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6494:x1876179322773504:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789264221.487403:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6494:x1876179322773504:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 268us (4880us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789264221.487412:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789264221.487489:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876179322773504:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789264221.487578:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1789264221.487617:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.487628:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.487636:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.487644:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264221.487648:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.487656:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.487671:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7dca800) 00010000:00010000:1.0:1789264221.487675:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789264221.487680:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.487687:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed6feb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789264221.487833:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789264221.487949:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789264221.487960:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 301829215674ns, next at 302829213621ns, rc = 0 00000001:00080000:1.0:1789264221.487966:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1789264221.487987:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7dca800) 00010000:00010000:1.0:1789264221.487990:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789264221.488004:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed6fd6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaad0 expref: 30 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264221.488097:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+29:11127:x1876179311165824:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 24881us (25029us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1789264221.488106:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 8 00000020:00080000:1.0:1789264221.488110:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789264221.493154:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264221.494656:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311166080 00000100:00100000:2.0:1789264221.494671:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311166080 00000100:00100000:2.0:1789264221.494760:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:2.0:1789264221.494771:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+29:11127:x1876179311166080:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264221.494795:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264221.494819:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6ff2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaad7 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.494957:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6ff2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaad7 expref: 30 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.494972:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6ff2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaad7 expref: 30 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.494992:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:2.0:1789264221.494995:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789264221.494998:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622c00, rc 0) 00000100:00100000:2.0:1789264221.495053:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+30:11127:x1876179311166080:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 284us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264221.495060:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:3.0:1789264221.498625:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264221.498828:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311166336 00000100:00100000:0.0:1789264221.498839:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311166336 00000100:00100000:0.0:1789264221.500070:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:0.0:1789264221.500087:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab27a4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+30:11127:x1876179311166336:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1789264221.500492:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab27a4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+31:11127:x1876179311166336:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 409us (1875us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789264221.500500:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:0.0:1789264221.592336:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264221.592443:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311166592 00000100:00100000:1.0:1789264221.592453:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311166592 00000100:00100000:1.0:1789264221.592509:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:1.0:1789264221.592519:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+31:11137:x1876179311166592:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1789264221.592542:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264221.592570:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed6ff9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaade expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264221.592698:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789264221.592835:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed6ff9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaade expref: 33 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.592847:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c39824a1a00) 00010000:00010000:1.0:1789264221.592849:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789264221.592863:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed6ff9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaade expref: 33 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264221.592877:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44e00, rc 0) 00000100:00100000:1.0:1789264221.592936:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+32:11137:x1876179311166592:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 419us (619us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1789264221.592944:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:1.0:1789264221.597299:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264221.597378:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311166720 00000100:00100000:2.0:1789264221.597389:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311166720 00000100:00100000:2.0:1789264221.597450:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:2.0:1789264221.597470:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+32:11137:x1876179311166720:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:2.0:1789264221.597555:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7007 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.597584:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7007 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.597596:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7007 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.597652:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed700e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.597661:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed700e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.597669:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed700e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.597773:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7015 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.597782:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7015 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.597789:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7015 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789264221.597834:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7015 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.597846:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7007 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.597964:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7007 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.597982:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7007 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.597989:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264221.597993:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7007 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598000:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7007 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598012:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:2.0:1789264221.598015:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264221.598019:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7007 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598026:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7007 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598038:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed700e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598045:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed700e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598050:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed700e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598054:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264221.598057:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed700e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598072:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed700e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598081:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3ab7dca700) 00010000:00010000:2.0:1789264221.598083:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264221.598097:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed700e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598104:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed700e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598114:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7015 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598120:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7015 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598126:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7015 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598131:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622a00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264221.598134:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7015 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598404:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7015 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598417:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:2.0:1789264221.598420:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264221.598423:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7015 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.598439:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7015 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264221.598680:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+32:11137:x1876179311166720:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 1218us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264221.598688:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:2.0:1789264221.604225:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264221.604365:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311166976 00000100:00100000:1.0:1789264221.604374:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311166976 00000100:00100000:1.0:1789264221.604486:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:1.0:1789264221.604497:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+32:11137:x1876179311166976:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:1.0:1789264221.604725:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+33:11137:x1876179311166976:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 229us (508us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789264221.604733:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:0.0:1789264221.666535:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264221.666642:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311167232 00000100:00100000:2.0:1789264221.666653:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311167232 00000100:00100000:2.0:1789264221.666713:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:2.0:1789264221.666722:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+33:11140:x1876179311167232:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264221.666780:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264221.666801:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed701c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaae5 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.666871:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7023 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.666885:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7023 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.666898:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7023 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.666910:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed702a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.666917:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed702a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.666942:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed702a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667044:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7031 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667052:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667059:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264221.667068:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789264221.667159:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7023 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667167:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7023 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667173:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7023 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667179:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264221.667184:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7023 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667191:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7023 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667204:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:2.0:1789264221.667207:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264221.667219:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7023 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667225:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7023 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667239:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed702a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667245:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed702a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667250:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed702a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667256:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622a00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264221.667259:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed702a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667264:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed702a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667271:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3ab7dca700) 00010000:00010000:2.0:1789264221.667273:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264221.667276:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed702a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667280:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed702a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667462:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed701c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaae5 expref: 36 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667491:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7031 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaae5 expref: 35 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264221.667498:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:2.0:1789264221.667500:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789264221.667502:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623200, rc 0) 00000100:00100000:2.0:1789264221.667586:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+35:11140:x1876179311167232:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 865us (1060us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789264221.667594:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:2.0:1789264221.670357:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264221.670457:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311167360 00000100:00100000:0.0:1789264221.670466:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311167360 00000100:00100000:0.0:1789264221.670525:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:0.0:1789264221.670534:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+35:11140:x1876179311167360:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:0.0:1789264221.670624:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed703f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.670642:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed703f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.670668:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed703f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.670702:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed703f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.670710:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed703f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.670717:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed703f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.670724:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ae00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264221.670728:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed703f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.670735:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed703f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.670791:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:0.0:1789264221.670795:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789264221.670800:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed703f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264221.670807:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed703f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264221.670892:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+35:11140:x1876179311167360:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 358us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264221.670899:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:3.0:1789264221.672713:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264221.672792:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311167616 00000100:00100000:0.0:1789264221.672815:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311167616 00000100:00100000:0.0:1789264221.672875:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:0.0:1789264221.672885:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+35:11140:x1876179311167616:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1789264221.674225:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+36:11140:x1876179311167616:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 1334us (1513us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789264221.674237:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 11 00010000:00010000:2.0:1789264221.835160:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264221.993672:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264221.993778:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311167872 00000100:00100000:3.0:1789264221.993788:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311167872 00000100:00100000:3.0:1789264221.993847:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:3.0:1789264221.993856:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+36:11171:x1876179311167872:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:3.0:1789264221.993880:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264221.993900:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7046 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaaec expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.994021:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed704d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.994034:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed704d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.994045:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed704d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264221.994056:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789264221.994191:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7046 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaec expref: 39 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.994209:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed704d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaec expref: 38 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264221.994217:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264221.994219:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789264221.994222:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36ac00, rc 0) 00000100:00100000:3.0:1789264221.994289:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+38:11171:x1876179311167872:12345-192.168.203.44@tcp:101:cat.0 Request processed in 434us (627us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789264221.994297:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:1.0:1789264222.002629:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264222.002739:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311168128 00000100:00100000:2.0:1789264222.002776:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311168128 00000100:00100000:2.0:1789264222.002844:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:2.0:1789264222.002866:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+38:11171:x1876179311168128:12345-192.168.203.44@tcp:35:cat.0 00000100:00100000:2.0:1789264222.003103:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+39:11171:x1876179311168128:12345-192.168.203.44@tcp:35:cat.0 Request processed in 249us (480us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789264222.003110:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:2.0:1789264222.010041:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264222.010437:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311168256 00000100:00100000:3.0:1789264222.010451:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311168256 00000100:00100000:3.0:1789264222.010538:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:3.0:1789264222.010560:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+39:2402:x1876179311168256:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264222.010580:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264222.010629:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed704d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaec expref: 39 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.010653:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264222.010659:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264222.010922:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+38:2402:x1876179311168256:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 372us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264222.010931:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:1.0:1789264222.069920:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264222.071581:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311168512 00000100:00100000:2.0:1789264222.071596:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311168512 00000100:00100000:2.0:1789264222.071686:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:2.0:1789264222.071706:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+38:11177:x1876179311168512:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:2.0:1789264222.071732:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264222.071735:0:9197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789264222.072056:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed6fb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaac2 expref: 38 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.072076:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:2.0:1789264222.072080:0:9197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789264222.072093:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed705b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaaf3 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.072199:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.072212:0:9197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7031 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaae5 expref: 38 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.072220:0:9197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.072251:0:9197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7031 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaae5 expref: 38 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.072265:0:9197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7031 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaae5 expref: 38 pid: 9197 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264222.072277:0:9197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9197:1876179322773632:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264222.072386:0:9197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264222.083143:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264222.083260:0:9197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9197:1876179322773632:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264222.083278:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311168640 00000100:00100000:0.0:1789264222.083290:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311168640 00010000:00010000:2.0:1789264222.083298:0:9197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.083372:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7031 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaae5 expref: 39 pid: 9197 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264222.083429:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:0.0:1789264222.083440:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+39:2402:x1876179311168640:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264222.083461:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264222.083469:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7031 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaae5 expref: 39 pid: 9197 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.083484:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7031 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaae5 expref: 39 pid: 9197 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.083513:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7031 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaae5 expref: 39 pid: 9197 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.083533:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:0.0:1789264222.083539:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.083579:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.083588:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.083630:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264222.083699:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+38:2402:x1876179311168640:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 259us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264222.083713:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 55 00010000:00010000:2.0:1789264222.083719:0:9197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.083740:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264222.083864:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789264222.084023:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed705b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaf3 expref: 39 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.084043:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaf3 expref: 38 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.084051:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:2.0:1789264222.084055:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789264222.084057:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622600, rc 0) 00000100:00100000:2.0:1789264222.084111:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+38:11177:x1876179311168512:12345-192.168.203.44@tcp:101:dd.0 Request processed in 12416us (14336us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789264222.084119:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:3.0:1789264222.088537:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264222.088738:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311168768 00000100:00100000:2.0:1789264222.089142:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311168768 00000100:00100000:3.0:1789264222.092141:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:3.0:1789264222.092155:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+38:11177:x1876179311168768:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:3.0:1789264222.092180:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264222.092202:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7070 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaafa expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.092240:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7077 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.092255:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.092268:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.094021:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7070 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaafa expref: 40 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.094050:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7077 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaafa expref: 39 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.094077:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264222.094080:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789264222.094084:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a000, rc 0) 00000100:00100000:3.0:1789264222.094197:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+39:11177:x1876179311168768:12345-192.168.203.44@tcp:101:dd.0 Request processed in 2044us (5674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264222.094206:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:1.0:1789264222.100519:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264222.100610:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311169024 00000100:00100000:0.0:1789264222.100627:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311169024 00000100:00100000:0.0:1789264222.100704:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:0.0:1789264222.100714:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+39:11177:x1876179311169024:12345-192.168.203.44@tcp:36:dd.0 00010000:00010000:0.0:1789264222.101057:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed707e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.101080:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed707e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.101094:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed707e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789264222.101160:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1789264222.101198:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bc7469d reply state 00000000b3bacb98 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed707e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.101214:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed707e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.101246:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:0.0:1789264222.101250:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789264222.101255:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789264222.101919:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+42:11177:x1876179311169024:12345-192.168.203.44@tcp:36:dd.0 Request processed in 1199us (1403us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789264222.101930:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 61 00000020:00080000:0.0:1789264222.101937:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789264222.218115:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322773760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789264222.218836:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322774016:0@lo:400:kworker.0 00000100:00100000:0.0:1789264222.218884:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264222.218958:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1876179322774528:0@lo:400:kworker.0 00000100:00100000:0.0:1789264222.218983:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264222.219008:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322775040:0@lo:400:kworker.0 00000100:00100000:0.0:1789264222.219031:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264222.219067:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789264222.219074:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322774400:0@lo:400:kworker.0 00000100:00100000:0.0:1789264222.219101:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264222.219120:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322774912:0@lo:400:kworker.0 00000100:00100000:3.0:1789264222.219362:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264222.219427:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322774272:0@lo:400:kworker.0 00000100:00100000:2.0:1789264222.219460:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322773888:0@lo:400:kworker.0 00000100:00100000:2.0:1789264222.219526:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264222.219588:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322774400 00000100:00100000:2.0:1789264222.219597:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322774400 00000100:00100000:2.0:1789264222.219666:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789264222.219676:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322774400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264222.219890:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322774144:0@lo:400:kworker.0 00000100:00100000:1.0:1789264222.219939:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264222.219968:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322774656:0@lo:400:kworker.0 00000100:00100000:1.0:1789264222.220020:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264222.220062:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322775168:0@lo:400:kworker.0 00000100:00100000:3.0:1789264222.220068:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264222.220111:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264222.220112:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322774784:0@lo:400:kworker.0 00000100:00100000:3.0:1789264222.220158:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264222.220181:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322775296:0@lo:400:kworker.0 00000100:00100000:3.0:1789264222.220205:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264222.220353:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322774400:12345-0@lo:400:kworker.0 Request processed in 678us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264222.220361:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789264222.220381:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322774144 00000100:00100000:2.0:1789264222.220384:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322774144 00000100:00100000:2.0:1789264222.220404:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789264222.220410:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322774144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264222.220447:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322774144:12345-0@lo:400:kworker.0 Request processed in 37us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264222.220453:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789264222.220578:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322774016 00000100:00100000:0.0:1789264222.220586:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322774016 00000100:00100000:0.0:1789264222.220636:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322774528 00000100:00100000:0.0:1789264222.220640:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322774528 00000100:00100000:0.0:1789264222.220670:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322775040 00000100:00100000:0.0:1789264222.220674:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322775040 00000100:00100000:0.0:1789264222.220698:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322774656 00000100:00100000:0.0:1789264222.220701:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322774656 00000100:00100000:0.0:1789264222.220715:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322774272 00000100:00100000:0.0:1789264222.220718:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322774272 00000100:00100000:0.0:1789264222.220762:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322775168 00000100:00100000:0.0:1789264222.220766:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322775168 00000100:00100000:0.0:1789264222.220786:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789264222.220795:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322774016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264222.220851:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322774016:12345-0@lo:400:kworker.0 Request processed in 57us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264222.220859:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789264222.220877:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789264222.220883:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876179322774528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264222.220913:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876179322774528:12345-0@lo:400:kworker.0 Request processed in 30us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264222.220919:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789264222.220931:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789264222.220937:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322775040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264222.220965:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322775040:12345-0@lo:400:kworker.0 Request processed in 29us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264222.220971:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789264222.220982:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789264222.220988:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322774656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264222.221015:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322774656:12345-0@lo:400:kworker.0 Request processed in 28us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264222.221022:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789264222.221033:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789264222.221039:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322774272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264222.223023:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322774784 00000100:00100000:2.0:1789264222.223039:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322774784 00000100:00100000:2.0:1789264222.223107:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322775296 00000100:00100000:2.0:1789264222.223111:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322775296 00000100:00100000:2.0:1789264222.223141:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789264222.223153:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaf87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322774784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264222.224055:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322774144:0@lo:400:kworker.0 00000100:00100000:3.0:1789264222.224065:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322774272:0@lo:400:kworker.0 00010000:00080000:1.0:1789264222.224092:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398374c700 x1876179322774656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264222.224105:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322774656:0@lo:400:kworker.0 00000100:00100000:3.0:1789264222.224123:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789264222.224139:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322775296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264222.224166:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322773760 00000100:00100000:1.0:1789264222.224175:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322773760 00000100:00100000:1.0:1789264222.224257:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789264222.224265:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1876179322773760:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264222.224280:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3623:x1876179322775296:12345-0@lo:400:kworker.0 Request processed in 77us (4003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264222.224293:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00002000:00000024:1.0:1789264222.224300:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264222.224348:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322775296:0@lo:400:kworker.0 00000100:00100000:3.0:1789264222.224374:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322773760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789264222.224383:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322773760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (5021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264222.224397:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789264222.224435:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322773888 00000100:00100000:1.0:1789264222.224440:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322773888 00000100:00100000:3.0:1789264222.224476:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789264222.224487:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789264222.224493:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322775168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264222.224568:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322775168:12345-0@lo:400:kworker.0 Request processed in 81us (4462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264222.224575:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789264222.224663:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322773888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264222.224724:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322773888:12345-0@lo:400:kworker.0 Request processed in 218us (5198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264222.224731:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00080000:1.0:1789264222.224842:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789264222.224848:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789264222.224852:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789264222.224855:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789264222.224917:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398374dc00 x1876179322775168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264222.224930:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322775168:0@lo:400:kworker.0 00000100:00100000:3.0:1789264222.224964:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322773888:0@lo:400:kworker.0 00000100:00100000:3.0:1789264222.224986:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789264222.224999:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322775552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264222.225008:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264222.225050:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ababbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322775424:0@lo:400:kworker.0 00000100:00100000:3.0:1789264222.225062:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264222.225096:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264222.225120:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322775552 00000100:00100000:3.0:1789264222.225128:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322775552 00000100:00100000:1.0:1789264222.225146:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322774016:0@lo:400:kworker.0 00000100:00100000:1.0:1789264222.225167:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1876179322774528:0@lo:400:kworker.0 00000100:00100000:1.0:1789264222.225189:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322775040:0@lo:400:kworker.0 00000100:00100000:3.0:1789264222.225197:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789264222.225237:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322774400:0@lo:400:kworker.0 00000100:00100000:1.0:1789264222.225260:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322774912 00000100:00100000:1.0:1789264222.225264:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322774912 00000100:00100000:1.0:1789264222.225290:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322775424 00000100:00100000:1.0:1789264222.225293:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322775424 00000100:00100000:1.0:1789264222.225315:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789264222.225322:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3625:x1876179322774912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264222.225330:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1876179322775552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789264222.225352:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264222.225381:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3625:x1876179322774912:12345-0@lo:400:kworker.0 Request processed in 56us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264222.225390:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789264222.225402:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789264222.225410:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3625:x1876179322775424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264222.225432:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1876179322775552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264222.225442:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789264222.225462:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322775424:12345-0@lo:400:kworker.0 Request processed in 51us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264222.225470:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789264222.225478:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789264222.225525:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322775552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264222.225790:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322774912:0@lo:400:kworker.0 00000100:00100000:1.0:1789264222.225804:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ababbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322775424:0@lo:400:kworker.0 00000100:00100000:0.0:1789264222.226653:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322774272:12345-0@lo:400:kworker.0 Request processed in 5609us (6586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264222.226688:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789264222.227147:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaf87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322774784:12345-0@lo:400:kworker.0 Request processed in 3989us (6980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264222.227160:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789264222.227498:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322774784:0@lo:400:kworker.0 00000100:00100000:0.0:1789264222.420209:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264222.420342:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311169152 00000100:00100000:3.0:1789264222.420355:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311169152 00000100:00100000:3.0:1789264222.420435:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:3.0:1789264222.420447:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+42:11191:x1876179311169152:12345-192.168.203.44@tcp:101:stat.0 00010000:00010000:3.0:1789264222.420479:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264222.420627:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7085 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab01 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.420719:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed708c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.420736:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed708c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.420808:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed708c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.420831:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7093 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.420839:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7093 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.420846:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7093 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.420937:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed709a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.420949:0:9197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaf3 expref: 43 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.420958:0:9197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed709a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.421059:0:9197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaf3 expref: 43 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.421085:0:9197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaf3 expref: 43 pid: 9197 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264222.421100:0:9197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9197:1876179322775680:192.168.203.44@tcp:104: 00000100:00100000:3.0:1789264222.421235:0:9197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264222.426982:0:9197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9197:1876179322775680:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264222.427026:0:9197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed709a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264222.434677:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264222.435010:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311169408 00000100:00100000:2.0:1789264222.435024:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311169408 00000100:00100000:2.0:1789264222.435135:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:2.0:1789264222.435148:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+44:6163:x1876179311169408:12345-192.168.203.44@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789264222.435589:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+45:6163:x1876179311169408:12345-192.168.203.44@tcp:35:ldlm_bl.0 Request processed in 442us (926us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789264222.435598:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:3.0:1789264222.440566:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264222.440677:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311169536 00000100:00100000:2.0:1789264222.440690:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311169536 00010000:00010000:2.0:1789264222.440741:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaf3 expref: 45 pid: 9197 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264222.440802:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:2.0:1789264222.440814:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+45:2402:x1876179311169536:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264222.440832:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264222.440840:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaf3 expref: 45 pid: 9197 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.440855:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaf3 expref: 45 pid: 9197 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.440883:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7062 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaaf3 expref: 45 pid: 9197 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.440902:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:2.0:1789264222.440907:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed709a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.440919:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed709a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.440928:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed709a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.440982:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264222.441055:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+44:2402:x1876179311169536:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 242us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264222.441063:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 56 00010000:00010000:3.0:1789264222.441189:0:9197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed709a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441270:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed709a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264222.441344:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789264222.441350:0:9197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264222.441403:0:9197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed709a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441419:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed709a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441429:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed708c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441437:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed708c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441445:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed708c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441452:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36ac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264222.441467:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed708c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441477:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed708c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441488:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:3.0:1789264222.441491:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264222.441495:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed708c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441502:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed708c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441516:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7093 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441523:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7093 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441529:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7093 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441534:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264222.441537:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7093 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441555:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7093 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441563:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3ab7dca700) 00010000:00010000:3.0:1789264222.441566:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264222.441575:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7093 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441581:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7093 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441622:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7085 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab01 expref: 44 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441638:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed709a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab01 expref: 43 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.441646:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264222.441649:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789264222.441651:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b400, rc 0) 00000100:00100000:3.0:1789264222.441706:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+43:11191:x1876179311169152:12345-192.168.203.44@tcp:101:stat.0 Request processed in 21261us (21511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264222.441713:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:3.0:1789264222.542929:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264222.543036:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311169792 00000100:00100000:1.0:1789264222.543054:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311169792 00000100:00100000:1.0:1789264222.543331:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:1.0:1789264222.543346:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+43:11197:x1876179311169792:12345-192.168.203.44@tcp:36:truncate.0 00010000:00010000:1.0:1789264222.543498:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264222.543537:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed709a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab01 expref: 43 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.543602:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:1.0:1789264222.543608:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789264222.543995:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44000/0xecaf9f2f14ed70a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.544013:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44000/0xecaf9f2f14ed70a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.544025:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44000/0xecaf9f2f14ed70a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789264222.544186:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1789264222.544213:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000430e928 reply state 00000000d2542bfe transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44000/0xecaf9f2f14ed70a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.544228:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44000/0xecaf9f2f14ed70a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.544234:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:1.0:1789264222.544237:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789264222.544241:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789264222.544608:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+45:11197:x1876179311169792:12345-192.168.203.44@tcp:36:truncate.0 Request processed in 1264us (1688us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789264222.544618:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 63 00000020:00080000:1.0:1789264222.544625:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789264222.721883:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264222.722022:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311169920 00000100:00100000:0.0:1789264222.722036:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311169920 00000100:00100000:0.0:1789264222.722107:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:0.0:1789264222.722120:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+45:11211:x1876179311169920:12345-192.168.203.44@tcp:101:stat.0 00010000:00010000:0.0:1789264222.722164:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264222.722203:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed70a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab08 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722288:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed70af lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722306:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed70af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722323:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed70af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722337:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed70b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722345:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed70b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722512:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed70b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722624:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed70bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722653:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed70bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722661:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed70bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264222.722718:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789264222.722722:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789264222.722801:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed70bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722815:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed70bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722824:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed70af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722831:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed70af lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722838:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed70af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722844:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366be00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264222.722849:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed70af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722856:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed70af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722870:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:0.0:1789264222.722879:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264222.722885:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed70af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722891:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed70af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722908:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed70b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722914:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed70b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722922:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed70b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722926:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ae00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264222.722929:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed70b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722935:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed70b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722943:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3ab7dca700) 00010000:00010000:0.0:1789264222.722945:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264222.722948:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed70b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722953:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed70b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.722985:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed70a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab08 expref: 47 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.723017:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed70bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab08 expref: 46 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264222.723025:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:0.0:1789264222.723027:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789264222.723030:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366a000, rc 0) 00000100:00100000:0.0:1789264222.723176:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+46:11211:x1876179311169920:12345-192.168.203.44@tcp:101:stat.0 Request processed in 1057us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264222.723184:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:1.0:1789264222.730036:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322775808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789264222.730145:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264222.730501:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322775808 00000100:00100000:2.0:1789264222.730513:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322775808 00000100:00100000:2.0:1789264222.730638:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789264222.730650:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322775808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789264222.730695:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789264222.731424:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322775808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 768us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264222.731436:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789264222.731788:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322775808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789264222.821647:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264222.824975:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311170176 00000100:00100000:3.0:1789264222.824997:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311170176 00000100:00100000:3.0:1789264222.826159:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 65 00000100:00100000:3.0:1789264222.826177:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+46:11221:x1876179311170176:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1789264222.826209:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264222.826242:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed70c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab0f expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264222.826410:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789264222.826555:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed70c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab0f expref: 48 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.826573:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c39824a1a00) 00010000:00010000:3.0:1789264222.826576:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789264222.826581:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed70c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab0f expref: 48 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.826598:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a800, rc 0) 00000100:00100000:3.0:1789264222.826708:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+47:11221:x1876179311170176:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 536us (5077us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1789264222.826716:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 65 00000100:00100000:3.0:1789264222.834458:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264222.834799:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311170432 00000100:00100000:0.0:1789264222.834813:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311170432 00000100:00100000:0.0:1789264222.835015:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00100000:0.0:1789264222.835027:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+47:11221:x1876179311170432:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1789264222.835661:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+48:11221:x1876179311170432:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 632us (1211us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1789264222.835672:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 14 00010000:00010000:2.0:1789264222.858049:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264222.902715:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264222.902872:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311170688 00000100:00100000:1.0:1789264222.902906:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311170688 00000100:00100000:1.0:1789264222.902993:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:1.0:1789264222.903007:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+48:11227:x1876179311170688:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:1.0:1789264222.903042:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264222.903076:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44400/0xecaf9f2f14ed70d2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab16 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.903467:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.903489:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed70bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab08 expref: 49 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.903502:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.903562:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed70bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab08 expref: 49 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.903579:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed70bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab08 expref: 49 pid: 6490 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264222.903597:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322775936:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264222.903730:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c22e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789264222.914061:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322775936:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264222.914105:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264222.915083:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264222.916222:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311170816 00000100:00100000:3.0:1789264222.916244:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311170816 00010000:00010000:3.0:1789264222.916414:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed70bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab08 expref: 50 pid: 6490 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264222.916535:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:3.0:1789264222.916559:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+50:2402:x1876179311170816:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264222.916579:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264222.916589:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed70bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab08 expref: 50 pid: 6490 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.916604:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed70bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab08 expref: 50 pid: 6490 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.916666:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed70bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab08 expref: 50 pid: 6490 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.916687:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264222.916694:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.916708:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.916716:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.916817:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264222.916898:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+49:2402:x1876179311170816:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 343us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264222.916908:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 57 00010000:00010000:2.0:1789264222.917534:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.917554:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264222.917579:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789264222.917784:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44400/0xecaf9f2f14ed70d2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab16 expref: 50 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.917826:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab16 expref: 49 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264222.917836:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:2.0:1789264222.917839:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789264222.917842:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44600, rc 0) 00000100:00100000:2.0:1789264222.917886:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+49:11227:x1876179311170688:12345-192.168.203.44@tcp:101:bash.0 Request processed in 14883us (15188us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789264222.917893:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:2.0:1789264222.937123:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264222.937391:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311171072 00000100:00100000:1.0:1789264222.937403:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311171072 00000100:00100000:1.0:1789264222.937477:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:1.0:1789264222.937487:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+49:11227:x1876179311171072:12345-192.168.203.44@tcp:36:bash.0 00010000:00010000:1.0:1789264222.937845:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed70e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.937877:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed70e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.937891:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed70e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789264222.937940:0:7904:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1789264222.937960:0:7904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2b5c070 reply state 00000000c91b9c91 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed70e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.937973:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed70e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.937981:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:1.0:1789264222.937985:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789264222.937989:0:7904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789264222.938100:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+52:11227:x1876179311171072:12345-192.168.203.44@tcp:36:bash.0 Request processed in 613us (988us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1789264222.938107:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 67 00000020:00080000:1.0:1789264222.938112:0:7904:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789264222.951256:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264222.951612:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311171200 00000100:00100000:3.0:1789264222.951625:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311171200 00000100:00100000:3.0:1789264222.951771:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:3.0:1789264222.951783:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+52:11227:x1876179311171200:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1789264222.951815:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264222.951841:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed70ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab1d expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.951972:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed70f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.952024:0:9197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab16 expref: 53 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.952033:0:9197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed70f5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.952093:0:9197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab16 expref: 53 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.952110:0:9197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab16 expref: 53 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264222.952126:0:9197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9197:1876179322776064:192.168.203.44@tcp:104: 00000100:00100000:3.0:1789264222.952339:0:9197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264222.956826:0:9197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9197:1876179322776064:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264222.956879:0:9197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed70f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264222.958201:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264222.958355:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311171328 00000100:00100000:1.0:1789264222.958367:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311171328 00010000:00010000:1.0:1789264222.958416:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab16 expref: 54 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264222.958465:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:1.0:1789264222.958476:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+54:2402:x1876179311171328:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264222.958515:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264222.958524:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab16 expref: 54 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.958552:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab16 expref: 54 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.958582:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed70d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab16 expref: 54 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.958601:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:1.0:1789264222.958606:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed70f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.958618:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed70f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.958626:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed70f5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264222.958656:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264222.958811:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+53:2402:x1876179311171328:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 335us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264222.958819:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 58 00010000:00010000:3.0:1789264222.959636:0:9197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed70f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.959650:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed70f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264222.959721:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789264222.959726:0:9197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264222.959793:0:9197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed70f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.959924:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed70ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab1d expref: 53 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.959946:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed70f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab1d expref: 52 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264222.959956:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264222.959959:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789264222.959962:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b200, rc 0) 00000100:00100000:3.0:1789264222.960015:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+52:11227:x1876179311171200:12345-192.168.203.44@tcp:101:bash.0 Request processed in 8234us (8774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264222.960097:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:0.0:1789264222.965006:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264222.965114:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311171584 00000100:00100000:2.0:1789264222.965128:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311171584 00000100:00100000:2.0:1789264222.965208:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:2.0:1789264222.965220:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab27a4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+52:11227:x1876179311171584:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:2.0:1789264222.965535:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab27a4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+53:11227:x1876179311171584:12345-192.168.203.44@tcp:35:bash.0 Request processed in 316us (541us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789264222.965553:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:1.0:1789264223.059028:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264223.059811:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311171840 00000100:00100000:2.0:1789264223.059826:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311171840 00000100:00100000:2.0:1789264223.059969:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:2.0:1789264223.059981:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+53:11237:x1876179311171840:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264223.060013:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264223.060063:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed70fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab24 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789264223.060087:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1789264223.060513:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789264223.060735:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed70fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab24 expref: 55 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.060776:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c39824a1a00) 00010000:00010000:2.0:1789264223.060779:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789264223.060784:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed70fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab24 expref: 55 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.060800:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623400, rc 0) 00000100:00100000:2.0:1789264223.060887:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+54:11237:x1876179311171840:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 908us (1876us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1789264223.060895:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:2.0:1789264223.065036:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264223.065432:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311171968 00000100:00100000:3.0:1789264223.065447:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311171968 00000100:00100000:3.0:1789264223.065581:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:3.0:1789264223.065594:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+54:11237:x1876179311171968:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:3.0:1789264223.065711:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed710a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.065735:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed710a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.065783:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed710a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.065797:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7111 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.065830:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.065837:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.065937:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7118 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.065947:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.065954:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789264223.066013:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066029:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed710a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066035:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed710a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066043:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed710a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066050:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36ac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264223.066056:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed710a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066064:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed710a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066104:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:3.0:1789264223.066107:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264223.066114:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed710a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066120:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed710a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066282:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066291:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7111 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066297:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066303:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264223.066314:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066321:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7111 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066331:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3ab7dca700) 00010000:00010000:3.0:1789264223.066333:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264223.066336:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7111 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066342:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7111 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066363:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066370:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7118 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066376:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7118 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066382:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264223.066385:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7118 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066391:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7118 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066400:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264223.066403:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264223.066406:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7118 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264223.066412:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7118 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264223.066585:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+54:11237:x1876179311171968:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 991us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264223.066595:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:0.0:1789264223.070871:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264223.070967:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311172224 00000100:00100000:2.0:1789264223.070979:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311172224 00000100:00100000:2.0:1789264223.071049:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:2.0:1789264223.071061:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+54:11237:x1876179311172224:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:2.0:1789264223.071382:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+55:11237:x1876179311172224:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 322us (525us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789264223.071392:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:1.0:1789264223.105644:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264223.106118:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311172480 00000100:00100000:3.0:1789264223.106199:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311172480 00000100:00100000:2.0:1789264223.106494:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 71 00000100:00100000:2.0:1789264223.106507:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+55:11240:x1876179311172480:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264223.106550:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264223.106595:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed711f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab2b expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.106709:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7126 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.106733:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7126 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.106770:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7126 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.106785:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed712d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.106792:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed712d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.106798:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed712d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107062:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7134 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107074:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107082:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264223.107093:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789264223.107204:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7126 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107223:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7126 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107230:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7126 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107236:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622a00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264223.107241:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7126 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107248:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7126 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107262:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:2.0:1789264223.107265:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264223.107270:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7126 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107277:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7126 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107291:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed712d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107296:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed712d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107301:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed712d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107316:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264223.107327:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed712d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107333:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed712d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107340:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3ab7dca700) 00010000:00010000:2.0:1789264223.107343:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264223.107345:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed712d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107351:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed712d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107392:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed711f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab2b expref: 58 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107407:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7134 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab2b expref: 57 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.107414:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:2.0:1789264223.107416:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789264223.107419:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623200, rc 0) 00000100:00100000:2.0:1789264223.107506:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+57:11240:x1876179311172480:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1001us (1878us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789264223.107514:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 71 00000100:00100000:2.0:1789264223.119226:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264223.119284:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264223.119389:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311172608 00000100:00100000:0.0:1789264223.119402:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311172608 00000100:00100000:0.0:1789264223.119482:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:0.0:1789264223.119495:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+57:2403:x1876179311172608:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264223.119515:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264223.119576:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7134 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab2b expref: 57 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.119601:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:0.0:1789264223.119606:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264223.119704:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+56:2403:x1876179311172608:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 211us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264223.119713:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:1.0:1789264223.122510:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311172736 00000100:00100000:1.0:1789264223.122532:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311172736 00000100:00100000:2.0:1789264223.122929:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 72 00000100:00100000:2.0:1789264223.122945:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+56:11240:x1876179311172736:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:2.0:1789264223.123170:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed7142 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.123194:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed7142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.123209:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed7142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.123258:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed7142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.123266:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed7142 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.123274:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed7142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.123282:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264223.123288:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed7142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.123297:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed7142 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.123324:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:2.0:1789264223.123329:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789264223.123333:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed7142 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.123341:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed7142 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264223.123908:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+56:11240:x1876179311172736:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 966us (4621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264223.123918:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 72 00000100:00100000:2.0:1789264223.127484:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264223.127575:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311172992 00000100:00100000:1.0:1789264223.127609:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311172992 00000100:00100000:1.0:1789264223.127700:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:1.0:1789264223.127713:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+56:11240:x1876179311172992:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:1.0:1789264223.128857:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+57:11240:x1876179311172992:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 1138us (1381us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789264223.128870:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:2.0:1789264223.182506:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264223.182564:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264223.182595:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264223.182632:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264223.182673:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311173632 00000100:00100000:2.0:1789264223.182686:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311173632 00000100:00100000:3.0:1789264223.182902:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311173376 00000100:00100000:3.0:1789264223.182928:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311173376 00000100:00100000:3.0:1789264223.182976:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 84 00000100:00100000:3.0:1789264223.182990:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2402:x1876179311173376:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264223.183093:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2402:x1876179311173376:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 107us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264223.183102:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 84 00000100:00100000:3.0:1789264223.183160:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264223.183325:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311173248 00000100:00100000:3.0:1789264223.183330:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311173248 00000100:00100000:3.0:1789264223.183358:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311173504 00000100:00100000:3.0:1789264223.183361:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311173504 00000100:00100000:3.0:1789264223.183381:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 204 00000100:00100000:3.0:1789264223.183388:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311173632:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264223.183425:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311173632:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 38us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264223.183431:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 204 00000100:00100000:3.0:1789264223.183445:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 205 00000100:00100000:3.0:1789264223.183451:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311173248:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264223.183474:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311173248:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264223.183479:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 205 00000100:00100000:3.0:1789264223.183490:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 206 00000100:00100000:3.0:1789264223.183495:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311173504:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264223.183516:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311173504:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 22us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264223.183533:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 206 00000100:00100000:0.0:1789264223.184091:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311173120 00000100:00100000:0.0:1789264223.184098:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311173120 00000100:00100000:0.0:1789264223.184149:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 361 00000100:00100000:0.0:1789264223.184158:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2402:x1876179311173120:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264223.184194:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2402:x1876179311173120:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 38us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264223.184201:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 361 00000100:00080000:0.0:1789264223.184234:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789264223.184240:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789264223.184243:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789264223.320957:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264223.321150:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311173888 00000100:00100000:2.0:1789264223.321165:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311173888 00000100:00100000:2.0:1789264223.321240:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 73 00000100:00100000:2.0:1789264223.321253:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+57:11258:x1876179311173888:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:2.0:1789264223.321285:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264223.321311:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed7149 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab32 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.321486:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed7150 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.321505:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed7150 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.321517:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed7150 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264223.321529:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789264223.321686:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed7149 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab32 expref: 60 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.323248:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed7150 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab32 expref: 59 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.323259:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:2.0:1789264223.323263:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789264223.323267:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623400, rc 0) 00000100:00100000:3.0:1789264223.328033:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+59:11258:x1876179311173888:12345-192.168.203.44@tcp:101:cat.0 Request processed in 6760us (7068us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1789264223.328049:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 73 00000100:00100000:0.0:1789264223.358265:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264223.360885:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311174016 00000100:00100000:1.0:1789264223.360908:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311174016 00000100:00100000:1.0:1789264223.361014:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 74 00000100:00100000:1.0:1789264223.361029:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+59:11259:x1876179311174016:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1789264223.361061:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264223.361160:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed715e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab39 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264223.361257:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed7165 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264223.361272:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed7165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264223.361285:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed7165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264223.361332:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789264223.361336:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789264223.361354:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed7165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264223.361382:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed715e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab39 expref: 61 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264223.361420:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed7165 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab39 expref: 60 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264223.361428:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:1.0:1789264223.361432:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789264223.361435:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45400, rc 0) 00000100:00100000:1.0:1789264223.361613:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11259:x1876179311174016:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 586us (3361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264223.361623:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 74 00000100:00100000:0.0:1789264223.370434:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264223.370532:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311174400 00000100:00100000:3.0:1789264223.370553:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311174400 00000100:00100000:3.0:1789264223.370614:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:3.0:1789264223.370624:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11259:x1876179311174400:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:3.0:1789264223.370979:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11259:x1876179311174400:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 355us (554us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789264223.370986:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:3.0:1789264223.379550:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264223.379663:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311174528 00000100:00100000:0.0:1789264223.379674:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311174528 00000100:00100000:0.0:1789264223.379789:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:0.0:1789264223.379801:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11259:x1876179311174528:12345-192.168.203.44@tcp:103:lfs.0 00010000:00010000:0.0:1789264223.379821:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789264223.379858:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed70f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab1d expref: 61 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.379908:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed7150 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab32 expref: 60 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.379923:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed6ff2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaad7 expref: 59 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.379932:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:0.0:1789264223.379937:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264223.379998:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+58:11259:x1876179311174528:12345-192.168.203.44@tcp:103:lfs.0 Request processed in 199us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264223.380005:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:0.0:1789264223.390142:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264223.390774:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311174656 00000100:00100000:2.0:1789264223.390786:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311174656 00000100:00100000:2.0:1789264223.390852:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 75 00000100:00100000:2.0:1789264223.390863:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+58:11259:x1876179311174656:12345-192.168.203.44@tcp:58:lfs.0 00010000:00010000:2.0:1789264223.390967:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed716c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.390985:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed716c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.390996:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed716c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789264223.391250:0:7904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789264223.391418:0:7904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789264223.391511:0:7904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789264223.391624:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+58:11259:x1876179311174656:12345-192.168.203.44@tcp:58:lfs.0 Request processed in 762us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264223.391633:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 75 00000100:00100000:3.0:1789264223.421035:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264223.421395:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311174784 00000100:00100000:0.0:1789264223.421409:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311174784 00000100:00100000:0.0:1789264223.421561:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 76 00000100:00100000:0.0:1789264223.421575:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+58:11261:x1876179311174784:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264223.421617:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264223.421646:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed7173 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab40 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.421787:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed717a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.421806:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed717a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.421822:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed717a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.421861:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7181 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.421870:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7181 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.421877:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7181 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.421968:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7188 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.421978:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.421985:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264223.422041:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789264223.422046:0:9197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789264223.422069:0:9197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422085:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422094:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed717a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422101:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed717a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422119:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed717a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422126:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ae00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264223.422142:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed717a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422151:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed717a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422166:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:0.0:1789264223.422170:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264223.422176:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed717a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422183:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed717a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422200:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7181 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422206:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7181 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422212:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7181 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422217:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366a200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264223.422221:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7181 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422237:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7181 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422246:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3ab7dca700) 00010000:00010000:0.0:1789264223.422248:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264223.422251:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7181 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422257:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7181 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422294:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed7173 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab40 expref: 60 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422638:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7188 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab40 expref: 59 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.422649:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:0.0:1789264223.422652:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789264223.422655:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366a000, rc 0) 00000100:00100000:0.0:1789264223.422876:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+59:11261:x1876179311174784:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1303us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264223.422886:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 76 00010000:00010000:2.0:1789264223.882919:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789264223.950137:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789264223.950146:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789264223.950180:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789264223.950190:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789264223.950332:0:13760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13760:1876179322776192:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789264223.950439:0:13760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264223.959106:0:13760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13760:1876179322776192:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789264223.961983:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264223.962184:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311174912 00000100:00100000:2.0:1789264223.962202:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311174912 00000100:00100000:2.0:1789264223.962262:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 77 00000100:00100000:2.0:1789264223.962272:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+59:11272:x1876179311174912:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789264223.962300:0:6491:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789264223.962415:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+59:11272:x1876179311174912:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 144us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264223.962423:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 77 00000100:00100000:3.0:1789264223.971637:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264223.971800:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311175040 00000100:00100000:2.0:1789264223.971811:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311175040 00000100:00100000:2.0:1789264223.971861:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 78 00000100:00100000:2.0:1789264223.971871:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+59:11272:x1876179311175040:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789264223.971953:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed718f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.971969:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed718f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.971981:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed718f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972052:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7196 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972060:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7196 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972067:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7196 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972095:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed719d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972118:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed719d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972127:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed719d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264223.972171:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789264223.972176:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264223.972189:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed719d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972200:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed718f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972207:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed718f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972214:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed718f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972220:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622a00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264223.972224:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed718f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972232:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed718f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972244:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e7c300) 00010000:00010000:2.0:1789264223.972247:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264223.972251:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed718f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972268:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed718f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972283:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7196 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972289:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7196 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972295:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7196 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972300:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264223.972303:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7196 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972308:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7196 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972316:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9c3ab7e7d500) 00010000:00010000:2.0:1789264223.972319:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264223.972321:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7196 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972327:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed7196 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972340:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed719d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972347:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed719d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972358:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed719d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972364:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622c00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264223.972367:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed719d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972373:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed719d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972382:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:2.0:1789264223.972384:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264223.972387:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed719d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264223.972393:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed719d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264223.972472:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+59:11272:x1876179311175040:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 Request processed in 602us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264223.972480:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 78 00000100:00100000:1.0:1789264223.978091:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264223.978634:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311175296 00000100:00100000:0.0:1789264223.978645:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311175296 00000100:00100000:0.0:1789264223.978708:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 79 00000100:00100000:0.0:1789264223.978717:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+59:11272:x1876179311175296:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264223.978780:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264223.978802:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed71a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab47 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.978908:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed71ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.978923:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed71ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.978946:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed71ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264223.978957:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789264223.979035:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed71ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.979043:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed71ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.979049:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed71ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.979056:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366a200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264223.979060:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed71ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.979067:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed71ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.979079:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:0.0:1789264223.979089:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789264223.979094:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed71ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.979101:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed71ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.979140:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed71a4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab47 expref: 61 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.979150:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e7c300) 00010000:00010000:0.0:1789264223.979153:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789264223.979161:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed71a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab47 expref: 61 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264223.979171:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366ae00, rc 0) 00000100:00100000:0.0:1789264223.979230:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11272:x1876179311175296:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 514us (1148us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1789264223.979237:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 79 00000100:00100000:0.0:1789264223.987973:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264223.988072:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311175424 00000100:00100000:1.0:1789264223.988091:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311175424 00000100:00100000:1.0:1789264223.988211:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 80 00000100:00100000:1.0:1789264223.988222:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11272:x1876179311175424:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789264223.988257:0:7904:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789264223.988384:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11272:x1876179311175424:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 163us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264223.988392:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 80 00000100:00100000:3.0:1789264223.991879:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264223.992086:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311175680 00000100:00100000:1.0:1789264223.992096:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311175680 00000100:00100000:1.0:1789264223.992162:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 81 00000100:00100000:1.0:1789264223.992173:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11272:x1876179311175680:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789264223.992190:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264223.992193:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789264223.992234:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed7165 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab39 expref: 60 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264223.992253:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:1.0:1789264223.992257:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789264223.992271:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed71b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab4e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789264223.992634:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789264223.992820:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed71c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264223.992834:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed71c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264223.992844:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed71c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264223.992894:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed71b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab4e expref: 62 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264223.992909:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed71c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab4e expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264223.992917:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7dca800) 00010000:00010000:1.0:1789264223.992920:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789264223.992922:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44e00, rc 0) 00000100:00100000:1.0:1789264223.993229:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11272:x1876179311175680:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1056us (1357us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789264223.993249:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 81 00000100:00100000:3.0:1789264224.002952:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264224.003051:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311175936 00000100:00100000:2.0:1789264224.003061:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311175936 00000100:00100000:2.0:1789264224.003118:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 82 00000100:00100000:2.0:1789264224.003129:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11272:x1876179311175936:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789264224.003185:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264224.003211:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed71c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab4e expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003249:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7dca800) 00010000:00010000:2.0:1789264224.003259:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789264224.003281:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71ce lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003294:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003304:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003372:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed71d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x100c928f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003380:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed71d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x100c928f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003388:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed71d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x100c928f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003437:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003444:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71ce lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003451:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003456:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622c00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264224.003461:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003475:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71ce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003484:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:2.0:1789264224.003487:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264224.003491:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003497:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003508:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed71d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x100c928f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003514:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed71d5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x100c928f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003520:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed71d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x100c928f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003525:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264224.003528:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed71d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x100c928f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003546:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed71d5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x100c928f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003553:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x100c928f (ffff9c3ab7e7d500) 00010000:00010000:2.0:1789264224.003555:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264224.003557:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed71d5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x100c928f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.003573:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed71d5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x100c928f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264224.003661:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11272:x1876179311175936:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 533us (718us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789264224.003668:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 82 00000100:00100000:1.0:1789264224.010290:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264224.010452:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311176064 00000100:00100000:2.0:1789264224.010463:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311176064 00000100:00100000:2.0:1789264224.010546:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 83 00000100:00100000:2.0:1789264224.010561:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11272:x1876179311176064:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789264224.010580:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264224.010602:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed71dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab55 expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.010639:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.010655:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.010666:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.010920:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed71dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab55 expref: 62 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.010948:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab55 expref: 61 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.010974:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7e7d500) 00010000:00010000:2.0:1789264224.010978:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789264224.010981:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622c00, rc 0) 00000100:00100000:2.0:1789264224.011730:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11272:x1876179311176064:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1169us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264224.011738:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 83 00000100:00100000:0.0:1789264224.017655:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264224.021145:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311176320 00000100:00100000:1.0:1789264224.021159:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311176320 00000100:00100000:1.0:1789264224.021226:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 84 00000100:00100000:1.0:1789264224.021237:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11272:x1876179311176320:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789264224.021351:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed71ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.021368:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed71ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.021381:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed71ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789264224.021609:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1789264224.021620:0:6492:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 304362874714ns, next at 305362872214ns, rc = 0 00000004:00010000:1.0:1789264224.021668:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5376003 reply state 00000000e0116549 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed71ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.021681:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed71ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.021690:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7e7d500) 00010000:00010000:1.0:1789264224.021692:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789264224.021696:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789264224.021840:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+63:11272:x1876179311176320:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 604us (4194us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789264224.021848:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 84 00000100:00100000:1.0:1789264224.032263:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264224.032325:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311176448 00000100:00100000:3.0:1789264224.032349:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311176448 00000100:00100000:3.0:1789264224.032407:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 85 00000100:00100000:3.0:1789264224.032418:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+63:11272:x1876179311176448:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789264224.032440:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264224.032461:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed71f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab5c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.032517:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed71f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab5c expref: 64 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.032540:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed71f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab5c expref: 64 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.032559:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7e7d500) 00010000:00010000:3.0:1789264224.032562:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789264224.032565:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b000, rc 0) 00000100:00100000:3.0:1789264224.032625:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+64:11272:x1876179311176448:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 209us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264224.032632:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 85 00000100:00100000:0.0:1789264224.044512:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264224.044831:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311176576 00000100:00100000:3.0:1789264224.044842:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311176576 00000100:00100000:3.0:1789264224.044945:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 32 00000100:00100000:3.0:1789264224.044953:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1876179311176576:12345-192.168.203.44@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789264224.044988:0:10317:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:3.0:1789264224.045029:0:10317:0:(genops.c:1385:class_connect()) connect: client 92638a4f-1391-4305-a4ab-5961bcacc46a, cookie 0xecaf9f2f14ed71f8 00002000:00100000:3.0:1789264224.045041:0:10317:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 92638a4f-1391-4305-a4ab-5961bcacc46a/ffff9c3983cea000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789264224.045068:0:10317:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789264224.046114:0:10317:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789264224.046159:0:10317:0:(import.c:65:import_set_state_nolock()) ffff9c3983ce9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789264224.046235:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2401:x1876179311176576:12345-192.168.203.44@tcp:8:lhsmtool_posix.0 Request processed in 1280us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264224.046243:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 32 00000100:00100000:3.0:1789264224.051697:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264224.052026:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311176704 00000100:00100000:2.0:1789264224.052036:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311176704 00000100:00100000:2.0:1789264224.052100:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:2.0:1789264224.052110:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:0:x1876179311176704:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789264224.052325:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789264224.062222:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:2.0:1789264224.062236:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 92638a4f-1391-4305-a4ab-5961bcacc46a 00000100:00100000:2.0:1789264224.062380:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:0:x1876179311176704:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 10268us (10687us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789264224.062392:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:2.0:1789264224.070641:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264224.074263:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311176960 00000100:00100000:0.0:1789264224.074277:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311176960 00000100:00100000:1.0:1789264224.075688:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:1.0:1789264224.075700:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+64:11272:x1876179311176960:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789264224.075945:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+65:11272:x1876179311176960:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 246us (5312us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1789264224.075953:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:2.0:1789264224.079597:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264224.079666:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311177216 00000100:00100000:1.0:1789264224.079676:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311177216 00000100:00100000:1.0:1789264224.079731:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 86 00000100:00100000:1.0:1789264224.079740:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+65:11272:x1876179311177216:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789264224.079863:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+65:11272:x1876179311177216:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 123us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264224.079869:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 86 00000100:00100000:0.0:1789264224.087864:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264224.088030:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311177344 00000100:00100000:2.0:1789264224.088039:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311177344 00000100:00100000:2.0:1789264224.088101:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 87 00000100:00100000:2.0:1789264224.088112:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+65:11272:x1876179311177344:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789264224.089612:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264224.089641:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed71ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab63 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.089720:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7206 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.089734:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.089761:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264224.089802:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264224.089821:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.089847:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed71ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab63 expref: 67 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.089862:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7206 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab63 expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.089871:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7e7d500) 00010000:00010000:2.0:1789264224.089874:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789264224.089877:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623200, rc 0) 00000100:00100000:2.0:1789264224.089938:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+66:11272:x1876179311177344:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1829us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264224.089946:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 87 00000100:00100000:3.0:1789264224.095263:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264224.095330:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311177472 00000100:00100000:1.0:1789264224.095339:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311177472 00000100:00100000:1.0:1789264224.095394:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:1.0:1789264224.095404:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2403:x1876179311177472:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789264224.095420:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264224.095442:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed720d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab6a expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789264224.095467:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa60160, blocks: 0x0 00010000:00010000:1.0:1789264224.095486:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=304s v=(0 0) 00010000:00010000:1.0:1789264224.095490:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264224.095499:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed720d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab6a expref: 6 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.095541:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed720d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab6a expref: 6 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.095555:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44e00, rc 0) 00000100:00100000:1.0:1789264224.095620:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2403:x1876179311177472:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 217us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264224.095627:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:0.0:1789264224.100193:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264224.100318:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311177728 00000100:00100000:3.0:1789264224.100328:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311177728 00000100:00100000:3.0:1789264224.100386:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 88 00000100:00100000:3.0:1789264224.100395:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+66:11272:x1876179311177728:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789264224.100502:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+66:11272:x1876179311177728:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 107us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264224.100509:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 88 00000100:00100000:3.0:1789264224.108511:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264224.108607:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311177856 00000100:00100000:0.0:1789264224.108617:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311177856 00000100:00100000:0.0:1789264224.108676:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:0.0:1789264224.108687:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+6:11272:x1876179311177856:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264224.108714:0:10317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264224.108732:0:10317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed7214 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab71 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.108790:0:10317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed720d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab6a expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.108800:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264224.108804:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264224.108810:0:10317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed7214 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab71 expref: 7 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.108842:0:10317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed720d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab6a expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.108857:0:10317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed720d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab6a expref: 7 pid: 8403 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264224.108872:0:10317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983112300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10317:1876179322776320:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264224.108963:0:10317:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8f332540 going to sleep for 11 seconds 00000100:00100000:0.0:1789264224.115647:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264224.115790:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311177984 00000100:00100000:3.0:1789264224.115799:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311177984 00010000:00010000:3.0:1789264224.115838:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed720d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab6a expref: 8 pid: 8403 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264224.115875:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:3.0:1789264224.115884:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311177984:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264224.115899:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264224.115920:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed720d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab6a expref: 8 pid: 8403 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.115947:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed720d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab6a expref: 8 pid: 8403 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.115972:0:7892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264224.115976:0:7892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264224.115984:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed7214 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab71 expref: 8 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.115996:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed7214 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab71 expref: 8 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.116031:0:7892:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed7214 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab71 expref: 8 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264224.116044:0:7892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac61180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1876179322776448:192.168.203.44@tcp:105: 00000100:00100000:3.0:1789264224.116117:0:7892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308fe40 going to sleep for 11 seconds 00010000:00010000:2.0:1789264224.116663:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5fdb43a/0xecaf9f2f14ed720d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab6a expref: 8 pid: 8403 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264224.116692:0:10317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983112300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10317:1876179322776320:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264224.116719:0:10317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed7214 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab71 expref: 7 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.116731:0:10317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366bc00, rc 0) 00000100:00100000:2.0:1789264224.117181:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+7:11272:x1876179311177856:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 8494us (8678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264224.117188:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:2.0:1789264224.130094:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264224.130312:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311178112 00000100:00100000:1.0:1789264224.130322:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311178112 00002000:00100000:1.0:1789264224.130371:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9c3abac6a680 x1876179311178112/t0(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:305/0 lens 504/0 e 0 to 0 dl 1789264235 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789264224.130383:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3abac6a680 with x1876179311178112 ext(0->8) 00002000:00010000:1.0:1789264224.130389:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c3abac6a680 00000100:00100000:1.0:1789264224.130425:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:1.0:1789264224.130436:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2403:x1876179311178112:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789264224.131281:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2403:x1876179311178112:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 Request processed in 843us (1191us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789264224.131291:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 0 00002000:00100000:1.0:1789264224.131298:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9c3abac6a680 x1876179311178112/t4294967303(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:305/0 lens 504/448 e 0 to 0 dl 1789264235 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789264224.131307:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3abac6a680 with x1876179311178112 ext(0->8) 00002000:00010000:1.0:1789264224.131311:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c3abac6a680 00000100:00100000:3.0:1789264224.131815:0:7892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac61180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1876179322776448:192.168.203.44@tcp:105: 00010000:00010000:3.0:1789264224.131836:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264224.131872:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311177984:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 15989us (16235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264224.131884:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:2.0:1789264224.133714:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264224.133877:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311178240 00000100:00100000:1.0:1789264224.133886:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311178240 00000100:00100000:1.0:1789264224.133981:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89 00000100:00100000:1.0:1789264224.133992:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+66:11272:x1876179311178240:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789264224.150709:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1789264224.150726:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1789264224.150804:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789264224.150820:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c3983c22f00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789264224.150825:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c39827af000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c3983c22b40 00000020:00080000:2.0:1789264224.150828:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c39827afa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c3a88df4800 00000100:00100000:2.0:1789264224.150981:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+20:11272:x1876179311178240:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 Request processed in 16986us (17271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264224.150990:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89 00000100:00100000:0.0:1789264224.151373:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322776576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789264224.151421:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264224.151475:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322776704:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789264224.151495:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264224.151543:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322776576 00000100:00100000:0.0:1789264224.151550:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322776576 00000100:00100000:0.0:1789264224.151588:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322776704 00000100:00100000:0.0:1789264224.151590:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322776704 00000100:00100000:0.0:1789264224.151611:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789264224.151618:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322776576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789264224.151733:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789264224.151737:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789264224 00002000:00010000:0.0:1789264224.151740:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789264224.151758:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789264224 -> 1789264224 00002000:00010000:0.0:1789264224.151760:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789264224.151793:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3623:x1876179322776576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (372us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789264224.151800:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789264224.151815:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789264224.151821:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3624:x1876179322776704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789264224.151834:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1789264224.151861:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa6015d, atime: 0x6aa6015d, ctime: 0x6aa6015d, blocks: 0x8 00010000:00010000:0.0:1789264224.151868:0:8406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006409edf9/0xecaf9f2f14ed721b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.151883:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=304s v=(0 0) 00010000:00010000:0.0:1789264224.151887:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264224.151893:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006409edf9/0xecaf9f2f14ed721b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.151910:0:8406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006409edf9/0xecaf9f2f14ed721b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.151931:0:8406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006409edf9/0xecaf9f2f14ed721b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.151938:0:8406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006409edf9/0xecaf9f2f14ed721b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.151955:0:8406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789264224.152057:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3624:x1876179322776704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 237us (561us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789264224.152064:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789264224.152082:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1789264224.152084:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00080000:0.0:1789264224.152085:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789264224.152115:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c3983112a00/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789264224.152121:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322776576:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789264224.152134:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264224.152140:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006409edf9/0xecaf9f2f14ed721b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.152148:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b400 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:0.0:1789264224.152151:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006409edf9/0xecaf9f2f14ed721b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.152160:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006409edf9/0xecaf9f2f14ed721b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.152187:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006409edf9/0xecaf9f2f14ed721b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.152194:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006409edf9/0xecaf9f2f14ed721b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.152211:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264224.152212:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264224.152214:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789264224.152231:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c3983113480/2, rc 0, transno 4294967302 00000020:00080000:1.0:1789264224.152232:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789264224.152235:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322776704:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789264224.152344:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6f2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152353:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6f2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152365:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6f2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152371:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264224.152375:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6f2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152381:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6f2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152391:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c3983364f00) 00010000:00010000:3.0:1789264224.152394:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264224.152398:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6f2e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152404:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed6f2e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152421:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6f35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152426:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6f35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152431:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6f35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152436:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264224.152438:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6f35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152451:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6f35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152459:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:3.0:1789264224.152461:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264224.152465:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6f35 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152470:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed6f35 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152482:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed6f74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152489:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed6f74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152494:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed6f74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152499:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264224.152501:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed6f74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152508:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed6f74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152515:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3ab7dca700) 00010000:00010000:3.0:1789264224.152518:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264224.152521:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed6f74 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152544:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed6f74 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152561:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed707e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152568:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed707e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152574:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed707e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152579:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264224.152582:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed707e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152587:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed707e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152596:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264224.152598:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264224.152601:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed707e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152606:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed707e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152616:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44000/0xecaf9f2f14ed70a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152622:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44000/0xecaf9f2f14ed70a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152634:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44000/0xecaf9f2f14ed70a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152639:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264224.152642:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44000/0xecaf9f2f14ed70a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152648:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44000/0xecaf9f2f14ed70a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152656:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264224.152658:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264224.152661:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44000/0xecaf9f2f14ed70a1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152667:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44000/0xecaf9f2f14ed70a1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152678:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed70e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152684:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed70e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152690:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed70e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152695:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264224.152697:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed70e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152712:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed70e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152721:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264224.152723:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264224.152726:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed70e7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152732:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed70e7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152806:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed71ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152814:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed71ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152820:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed71ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152825:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264224.152828:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed71ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152834:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed71ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152841:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7e7d500) 00010000:00010000:3.0:1789264224.152843:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789264224.152846:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed71ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.152860:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed71ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264224.154474:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264224.154553:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311178368 00000100:00100000:2.0:1789264224.154563:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311178368 00000100:00100000:2.0:1789264224.154670:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 38 00000100:00100000:2.0:1789264224.154681:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2403:x1876179311178368:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789264224.156010:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1789264224.156021:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1789264224.156112:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2403:x1876179311178368:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 Request processed in 1431us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264224.156121:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 38 00000040:00080000:0.0:1789264224.158675:0:14168:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789264224.158686:0:14168:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789264224.158709:0:14168:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789264224.158715:0:14168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789264224.175136:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264224.175195:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311178624 00000100:00100000:0.0:1789264224.175205:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311178624 00000100:00100000:0.0:1789264224.175267:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 90 00000100:00100000:0.0:1789264224.175278:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+14:11272:x1876179311178624:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789264224.175497:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264224.175524:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed7206 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab63 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.175553:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7e7d500) 00010000:00010000:0.0:1789264224.175558:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264224.175718:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7222 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.175734:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7222 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.175766:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7222 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789264224.176019:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4fce93f reply state 0000000052bb34e5 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7222 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.176035:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7222 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.176047:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7e7d500) 00010000:00010000:0.0:1789264224.176050:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789264224.176053:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789264224.176145:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+15:11272:x1876179311178624:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 869us (1022us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789264224.176153:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 90 00000100:00100000:2.0:1789264224.190105:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264224.193096:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311178752 00000100:00100000:0.0:1789264224.193108:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311178752 00000100:00100000:0.0:1789264224.193165:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:0.0:1789264224.193175:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2403:x1876179311178752:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789264224.193318:0:8403:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789264224.193323:0:8403:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789264224 -> 1789264223 00002000:00010000:0.0:1789264224.193326:0:8403:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789264221 00002000:00010000:0.0:1789264224.193328:0:8403:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789264224 -> 1789264223 00002000:00010000:0.0:1789264224.193330:0:8403:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789264224.193402:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2403:x1876179311178752:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 228us (3306us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789264224.193410:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:3.0:1789264224.195849:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264224.198282:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311179008 00000100:00100000:2.0:1789264224.198296:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311179008 00000100:00100000:2.0:1789264224.198775:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 91 00000100:00100000:2.0:1789264224.198786:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+15:11272:x1876179311179008:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789264224.198847:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.198862:0:7904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab55 expref: 15 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.198873:0:7904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.198903:0:7904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab55 expref: 15 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.198916:0:7904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab55 expref: 15 pid: 7904 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264224.198930:0:7904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aae23dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7904:1876179322776832:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264224.199016:0:7904:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d4480 going to sleep for 11 seconds 00000100:00100000:2.0:1789264224.203968:0:7904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aae23dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7904:1876179322776832:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264224.203998:0:7904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264224.207009:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264224.207482:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311179136 00000100:00100000:0.0:1789264224.207492:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311179136 00010000:00010000:0.0:1789264224.207541:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab55 expref: 16 pid: 7904 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264224.207587:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:0.0:1789264224.207597:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+16:2402:x1876179311179136:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264224.207614:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264224.207621:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab55 expref: 16 pid: 7904 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.207635:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab55 expref: 16 pid: 7904 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.207659:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed71e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab55 expref: 16 pid: 7904 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.207673:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7e7d500) 00010000:00010000:0.0:1789264224.207679:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.207690:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.207699:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.207741:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264224.207818:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+15:2402:x1876179311179136:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 222us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264224.207826:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 60 00010000:00010000:2.0:1789264224.207961:0:7904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.207971:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.208009:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.208017:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.208025:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.208031:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622a00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264224.208036:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.208045:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.208056:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7e7d500) 00010000:00010000:2.0:1789264224.208059:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789264224.208063:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.208081:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed7229 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264224.208122:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+14:11272:x1876179311179008:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 Request processed in 9338us (12279us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789264224.208131:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 91 00000100:00100000:1.0:1789264224.214395:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264224.214500:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311179264 00000100:00100000:0.0:1789264224.214511:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311179264 00000100:00100000:0.0:1789264224.214571:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:0.0:1789264224.214581:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2404:x1876179311179264:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789264224.214625:0:11052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed7230 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.214648:0:11052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed7214 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab71 expref: 7 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.214657:0:11052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264224.214662:0:11052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789264224.214667:0:11052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed7230 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.214703:0:11052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed7214 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab71 expref: 7 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.214717:0:11052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed7214 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab71 expref: 7 pid: 10317 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264224.214730:0:11052:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11052:1876179322776960:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264224.214827:0:11052:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8f332f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789264224.222213:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264224.222287:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311179392 00000100:00100000:1.0:1789264224.222296:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311179392 00010000:00010000:1.0:1789264224.222348:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed7214 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab71 expref: 8 pid: 10317 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264224.222387:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:1.0:1789264224.222398:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311179392:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264224.222413:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264224.222438:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed7214 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab71 expref: 8 pid: 10317 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.222453:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed7214 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab71 expref: 8 pid: 10317 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.222479:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789264224.222484:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789264224.222489:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed7230 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.222501:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed7230 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.222545:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264224.222599:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311179392:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 202us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264224.222606:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 61 00010000:00010000:0.0:1789264224.223079:0:11052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed7214 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab71 expref: 7 pid: 10317 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264224.223096:0:11052:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11052:1876179322776960:192.168.203.44@tcp:104: 00010000:00010000:0.0:1789264224.223117:0:11052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed7230 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.223256:0:11052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed7230 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.223265:0:11052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed7230 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.223287:0:11052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed7230 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.223294:0:11052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed7230 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.223301:0:11052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed7230 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.223307:0:11052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366a200 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264224.223311:0:11052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed7230 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.223319:0:11052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed7230 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.223349:0:11052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed7230 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264224.223357:0:11052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed7230 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264224.223421:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2404:x1876179311179264:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 Request processed in 8841us (9035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264224.223430:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:2.0:1789264224.232163:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264224.232281:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311179648 00000100:00100000:3.0:1789264224.232290:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311179648 00000100:00100000:3.0:1789264224.232356:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 92 00000100:00100000:3.0:1789264224.232366:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+14:11272:x1876179311179648:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789264224.232442:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.232459:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7077 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaafa expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.232469:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.232502:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7077 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaafa expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.232517:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7077 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaafa expref: 14 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264224.232541:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac61500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322777088:192.168.203.44@tcp:104: 00000100:00100000:3.0:1789264224.232629:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398308fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264224.234322:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac61500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322777088:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264224.234349:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264224.235041:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264224.235097:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311179776 00000100:00100000:3.0:1789264224.235103:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311179776 00010000:00010000:3.0:1789264224.235137:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7077 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaafa expref: 15 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264224.235171:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:3.0:1789264224.235178:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+15:2402:x1876179311179776:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264224.235191:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264224.235197:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7077 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaafa expref: 15 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.235208:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7077 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaafa expref: 15 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.235228:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7077 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaafa expref: 15 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.235242:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264224.235246:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.235256:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.235279:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.235311:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264224.235359:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+14:2402:x1876179311179776:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 181us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264224.235366:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 62 00010000:00010000:2.0:1789264224.235495:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.235503:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.235691:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.235702:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed71f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab5c expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.235711:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.235734:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed71f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab5c expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.235780:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed71f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab5c expref: 14 pid: 6490 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264224.235805:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322777216:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264224.235852:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d4600 going to sleep for 11 seconds 00000100:00100000:3.0:1789264224.238375:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322777216:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264224.238406:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264224.239791:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264224.240427:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311179904 00000100:00100000:0.0:1789264224.240436:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311179904 00010000:00010000:0.0:1789264224.240471:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed71f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab5c expref: 15 pid: 6490 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264224.240520:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:0.0:1789264224.240539:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+15:2402:x1876179311179904:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264224.240554:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264224.240562:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed71f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab5c expref: 15 pid: 6490 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.240574:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed71f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab5c expref: 15 pid: 6490 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.240597:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed71f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab5c expref: 15 pid: 6490 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.240610:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7e7d500) 00010000:00010000:0.0:1789264224.240622:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.240632:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.240643:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264224.240834:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264224.240894:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+14:2402:x1876179311179904:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 365us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264224.240901:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 63 00010000:00010000:3.0:1789264224.240959:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.240968:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789264224.241071:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1789264224.242604:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1789264224.242646:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1789264224.242720:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac61500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6492:1876179322777344:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789264224.242801:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264224.242832:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a852dc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264224.242913:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322777344 00000100:00100000:0.0:1789264224.242920:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322777344 00000100:00100000:0.0:1789264224.242971:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789264224.242980:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6492:x1876179322777344:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789264224.243061:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6492:x1876179322777344:12345-0@lo:1000:mdt00_002.0 Request processed in 81us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264224.243068:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789264224.243506:0:6492:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789264224.243514:0:6492:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c3983112a00, transno 4294967304 00000100:00100000:3.0:1789264224.243574:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac61500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6492:1876179322777344:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789264224.243697:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1789264224.243777:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6492:1876179322777472:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789264224.243811:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264224.243825:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc240 going to sleep for 11 seconds 00000100:00100000:0.0:1789264224.243881:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322777472 00000100:00100000:0.0:1789264224.243885:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322777472 00000100:00100000:0.0:1789264224.243923:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789264224.243931:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6492:x1876179322777472:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789264224.244025:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6492:x1876179322777472:12345-0@lo:1000:mdt00_002.0 Request processed in 94us (213us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789264224.244031:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789264224.244114:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6492:1876179322777472:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789264224.244157:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244167:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244175:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244181:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622a00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264224.244185:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244193:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244208:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7e7d500) 00010000:00010000:3.0:1789264224.244211:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789264224.244215:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244220:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed723e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244244:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed716c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244250:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed716c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244261:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed716c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244266:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264224.244268:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed716c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244273:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed716c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244281:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264224.244282:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789264224.244285:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed716c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244289:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed716c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244324:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244336:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7188 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab40 expref: 17 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244344:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244366:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7188 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab40 expref: 17 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.244389:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7188 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab40 expref: 17 pid: 9197 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264224.244400:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322777600:192.168.203.44@tcp:104: 00000100:00100000:3.0:1789264224.244463:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc240 going to sleep for 11 seconds 00000100:00100000:3.0:1789264224.247841:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264224.247887:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322777600:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264224.247911:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264224.247938:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311180032 00000100:00100000:3.0:1789264224.247944:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311180032 00010000:00010000:3.0:1789264224.247974:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7188 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab40 expref: 18 pid: 9197 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264224.248003:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:3.0:1789264224.248011:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+18:2403:x1876179311180032:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264224.248024:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264224.248031:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7188 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab40 expref: 18 pid: 9197 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248043:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7188 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab40 expref: 18 pid: 9197 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248063:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7188 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab40 expref: 18 pid: 9197 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248083:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264224.248199:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248210:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248218:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248238:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264224.248287:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+17:2403:x1876179311180032:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 276us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264224.248294:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 64 00010000:00010000:3.0:1789264224.248379:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248386:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248398:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248404:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248411:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248416:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36aa00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264224.248425:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248432:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248441:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264224.248444:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264224.248448:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248454:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7245 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248463:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248469:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248476:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248481:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264224.248484:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248489:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248496:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c3ab7e7df00) 00010000:00010000:3.0:1789264224.248498:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789264224.248507:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.248513:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7237 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264224.248645:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+16:11272:x1876179311179648:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 16280us (16490us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789264224.248795:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 92 00000020:00080000:3.0:1789264224.248800:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789264224.248881:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789264224.248885:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789264224.248897:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789264224.248902:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789264224.251242:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264224.251376:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311180288 00000100:00100000:3.0:1789264224.251385:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311180288 00000100:00100000:3.0:1789264224.251434:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:3.0:1789264224.251445:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+16:11272:x1876179311180288:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789264224.251664:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789264224.251694:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1789264224.251725:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed724c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.251740:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed724c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.251832:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed724c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.251841:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed724c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.251857:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed724c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.251863:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed724c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264224.251973:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789264224.252056:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+18:11272:x1876179311180288:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 611us (817us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789264224.252064:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 20 00000020:00080000:2.0:1789264224.252070:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789264224.252429:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264224.252435:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed724c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.252442:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a000 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264224.252446:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed724c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.252453:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed724c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.252466:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7e7d500) 00010000:00010000:3.0:1789264224.252470:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789264224.252474:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed724c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.252480:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed724c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264224.252491:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264224.252492:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264224.252494:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264224.778106:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322777728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789264224.778194:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264224.778320:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322777728 00000100:00100000:3.0:1789264224.778328:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322777728 00000100:00100000:3.0:1789264224.778380:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789264224.778395:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1876179322777728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789264224.778422:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264224.778462:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1876179322777728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264224.778469:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789264224.778611:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322777856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789264224.778637:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264224.778767:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322777856 00000100:00100000:2.0:1789264224.778772:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322777856 00000100:00100000:2.0:1789264224.778814:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789264224.778821:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322777856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789264224.778831:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264224.778864:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322777856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264224.778870:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789264224.778912:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322777856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789264224.779114:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322777728:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789264224.779253:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789264224.907713:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789264225.289911:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789264225.289922:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789264225.289943:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789264225.289949:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789264225.291090:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322777984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789264225.291154:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264225.291273:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322777984 00000100:00100000:2.0:1789264225.291290:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322777984 00000100:00100000:2.0:1789264225.291342:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789264225.291349:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322777984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789264225.291380:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789264225.291419:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322777984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264225.291432:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789264225.296306:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322777984:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789264225.918247:0:14220:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789264225.918258:0:14220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789264225.918283:0:14220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789264225.918289:0:14220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789264225.930919:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789264225.994384:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789264226.036809:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.036845:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311180544 00000100:00100000:0.0:1789264226.036855:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311180544 00000100:00080000:3.0:1789264226.036901:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789264226.036913:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 93 00000100:00100000:0.0:1789264226.036923:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+18:11291:x1876179311180544:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264226.036945:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264226.036965:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7253 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab78 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.037078:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed725a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.037092:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed725a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.037103:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed725a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264226.037115:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789264226.037213:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7253 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab78 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.037244:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed725a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab78 expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.037252:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:0.0:1789264226.037255:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789264226.037259:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366be00, rc 0) 00000100:00100000:0.0:1789264226.037366:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+20:11291:x1876179311180544:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 443us (565us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789264226.037374:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 93 00000100:00100000:0.0:1789264226.040765:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.041387:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311180672 00000100:00100000:0.0:1789264226.041398:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311180672 00000100:00100000:0.0:1789264226.041458:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 94 00000100:00100000:0.0:1789264226.041469:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+20:11291:x1876179311180672:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:0.0:1789264226.041551:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7268 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041569:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7268 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041582:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7268 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041598:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed726f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041604:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed726f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041619:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed726f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041697:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7276 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041706:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041712:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789264226.041783:0:7904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041797:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7268 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041803:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7268 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041810:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7268 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041816:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366bc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.041820:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7268 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041827:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7268 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041839:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:0.0:1789264226.041849:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.041854:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7268 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041860:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7268 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041873:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed726f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041879:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed726f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041886:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed726f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041890:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.041893:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed726f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041899:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed726f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041906:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c39824a1f00) 00010000:00010000:0.0:1789264226.041908:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.041911:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed726f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041916:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed726f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041930:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041942:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7276 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041948:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7276 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041953:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366a000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.041956:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7276 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.041962:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7276 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.042237:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1100) 00010000:00010000:0.0:1789264226.042241:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.042246:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7276 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.042253:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7276 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264226.042476:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+20:11291:x1876179311180672:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 1007us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264226.042486:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 94 00000100:00100000:3.0:1789264226.071864:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.072343:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311180928 00000100:00100000:0.0:1789264226.072353:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311180928 00000100:00100000:0.0:1789264226.072419:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 95 00000100:00100000:0.0:1789264226.072429:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+20:11294:x1876179311180928:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264226.072448:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264226.072482:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed727d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab7f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.072567:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7284 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.072582:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7284 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.072593:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7284 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.072608:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed728b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.072616:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed728b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.072621:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed728b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.072734:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7292 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073028:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073039:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264226.073049:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789264226.073356:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7284 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073377:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7284 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073384:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7284 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073391:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.073396:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7284 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073403:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7284 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073416:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:0.0:1789264226.073419:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.073424:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7284 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073430:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7284 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073444:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed728b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073450:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed728b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073455:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed728b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073460:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366bc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.073470:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed728b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073476:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed728b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073485:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c39824a1100) 00010000:00010000:0.0:1789264226.073487:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.073491:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed728b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073496:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed728b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073559:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed727d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab7f expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073574:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7292 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab7f expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.073581:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:0.0:1789264226.073584:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789264226.073587:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366ac00, rc 0) 00000100:00100000:0.0:1789264226.073662:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+22:11294:x1876179311180928:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1233us (1928us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1789264226.073670:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 95 00000100:00100000:0.0:1789264226.077012:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.079645:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311181056 00000100:00100000:2.0:1789264226.079659:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311181056 00000100:00100000:2.0:1789264226.079730:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 96 00000100:00100000:2.0:1789264226.079741:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+22:11294:x1876179311181056:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:2.0:1789264226.079836:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.079852:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.079863:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.079897:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.079904:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.079911:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.079918:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622c00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264226.079922:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.079930:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.079961:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:2.0:1789264226.079963:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789264226.079968:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.079973:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264226.080053:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+22:11294:x1876179311181056:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 313us (3049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264226.080060:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 96 00000100:00100000:1.0:1789264226.082414:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.082491:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311181312 00000100:00100000:0.0:1789264226.082501:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311181312 00000100:00100000:0.0:1789264226.082569:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:0.0:1789264226.082591:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab27a7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+22:11294:x1876179311181312:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1789264226.082840:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab27a7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+23:11294:x1876179311181312:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 250us (435us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1789264226.082848:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:3.0:1789264226.120428:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.122433:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311181568 00000100:00100000:2.0:1789264226.122448:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311181568 00000100:00100000:2.0:1789264226.122511:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 97 00000100:00100000:2.0:1789264226.122533:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+23:10814:x1876179311181568:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1789264226.122556:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264226.122577:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72a7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab86 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.122675:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.122688:0:9197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7292 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab7f expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.122697:0:9197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.122729:0:9197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7292 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab7f expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.123124:0:9197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7292 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab7f expref: 24 pid: 6492 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264226.123139:0:9197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9197:1876179322778112:192.168.203.44@tcp:104: 00000100:00100000:3.0:1789264226.123409:0:9197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d4000 going to sleep for 11 seconds 00000100:00100000:0.0:1789264226.137612:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264226.137705:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311181696 00000100:00100000:1.0:1789264226.137713:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311181696 00010000:00010000:1.0:1789264226.137784:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7292 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab7f expref: 25 pid: 6492 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264226.137829:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 65 00000100:00100000:1.0:1789264226.137837:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+25:2402:x1876179311181696:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264226.137851:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264226.137858:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7292 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab7f expref: 25 pid: 6492 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.137888:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7292 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab7f expref: 25 pid: 6492 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.137909:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:1.0:1789264226.137915:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.137923:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.137931:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.137948:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264226.137991:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+25:2402:x1876179311181696:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 154us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264226.137998:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 65 00010000:00010000:3.0:1789264226.138364:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7292 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab7f expref: 24 pid: 6492 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264226.138381:0:9197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9197:1876179322778112:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264226.138402:0:9197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.138410:0:9197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.138416:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264226.138443:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789264226.138576:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab86 expref: 25 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.138591:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab86 expref: 24 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.138598:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:3.0:1789264226.138601:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789264226.138603:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5623400, rc 0) 00000100:00100000:3.0:1789264226.138648:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+24:10814:x1876179311181568:12345-192.168.203.44@tcp:101:bash.0 Request processed in 16128us (18371us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1789264226.138655:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 97 00000100:00100000:0.0:1789264226.141845:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.141945:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311181824 00000100:00100000:2.0:1789264226.141956:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311181824 00000100:00100000:2.0:1789264226.142013:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 98 00000100:00100000:2.0:1789264226.142023:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+24:10814:x1876179311181824:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1789264226.142047:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264226.142067:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed72bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab8d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.142102:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed72c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.142115:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed72c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.142127:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed72c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.142250:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622a00/0xecaf9f2f14ed72bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab8d expref: 26 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.142269:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed72c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab8d expref: 25 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.142290:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:2.0:1789264226.142293:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789264226.142296:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622200, rc 0) 00000100:00100000:2.0:1789264226.142350:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+25:10814:x1876179311181824:12345-192.168.203.44@tcp:101:bash.0 Request processed in 328us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264226.142356:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 98 00000100:00100000:1.0:1789264226.144854:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.144991:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311182080 00000100:00100000:2.0:1789264226.145000:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311182080 00000100:00100000:2.0:1789264226.145060:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 99 00000100:00100000:2.0:1789264226.145070:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+25:10814:x1876179311182080:12345-192.168.203.44@tcp:36:bash.0 00010000:00010000:2.0:1789264226.145418:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.145435:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.145446:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789264226.145488:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1789264226.145509:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcda6cc2 reply state 00000000e2c28e69 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.145532:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.145540:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:2.0:1789264226.145543:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789264226.145559:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789264226.145600:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1789264226.147125:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+29:10814:x1876179311182080:12345-192.168.203.44@tcp:36:bash.0 Request processed in 2050us (2274us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789264226.147136:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 99 00000020:00080000:2.0:1789264226.147142:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789264226.155945:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.159256:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311182208 00000100:00100000:0.0:1789264226.159274:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311182208 00000100:00100000:0.0:1789264226.159357:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 100 00000100:00100000:0.0:1789264226.159367:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+29:10814:x1876179311182208:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1789264226.159391:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264226.159412:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed72d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab94 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.159469:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed72d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab94 expref: 30 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.159483:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed72d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab94 expref: 30 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.159501:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:0.0:1789264226.159504:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789264226.159508:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366b000, rc 0) 00000100:00100000:0.0:1789264226.159587:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+30:10814:x1876179311182208:12345-192.168.203.44@tcp:101:bash.0 Request processed in 220us (3649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264226.159595:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 100 00000100:00100000:0.0:1789264226.164649:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.164828:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311182336 00000100:00100000:2.0:1789264226.164838:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311182336 00000100:00080000:3.0:1789264226.164891:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789264226.164950:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:2.0:1789264226.164962:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+6:10814:x1876179311182336:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1789264226.164978:0:10317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264226.165000:0:10317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025e15a98/0xecaf9f2f14ed72d8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdab9b expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789264226.165037:0:10317:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa6015f, atime: 0x6aa6015d, ctime: 0x6aa6015f, blocks: 0x8 00010000:00010000:2.0:1789264226.165060:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=306s v=(0 0) 00010000:00010000:2.0:1789264226.165064:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264226.165073:0:10317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025e15a98/0xecaf9f2f14ed72d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab9b expref: 7 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.165092:0:10317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000025e15a98/0xecaf9f2f14ed72d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab9b expref: 7 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.165104:0:10317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3ab5622a00, rc 0) 00000100:00100000:2.0:1789264226.165164:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+7:10814:x1876179311182336:12345-192.168.203.44@tcp:101:bash.0 Request processed in 205us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264226.165171:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:1.0:1789264226.167098:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264226.169843:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311182464 00000100:00100000:3.0:1789264226.169859:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311182464 00002000:00010000:3.0:1789264226.169903:0:8409:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1789264226.169908:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c398374df80 with x1876179311182464 ext(0->18446744073709551615) 00002000:00010000:3.0:1789264226.169921:0:8409:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c398374df80. 00000100:00100000:3.0:1789264226.170003:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:3.0:1789264226.170014:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2404:x1876179311182464:12345-192.168.203.44@tcp:10:bash.0 00002000:00010000:3.0:1789264226.170299:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789264226.170303:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789264223 -> 1789264226 00002000:00010000:3.0:1789264226.170306:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789264221 -> 1789264221 00002000:00010000:3.0:1789264226.170308:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789264223 -> 1789264226 00002000:00010000:3.0:1789264226.170319:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1789264226.170393:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2404:x1876179311182464:12345-192.168.203.44@tcp:10:bash.0 Request processed in 380us (3303us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789264226.170400:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 1 00002000:00010000:3.0:1789264226.170404:0:8409:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1789264226.170407:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c398374df80 with x1876179311182464 ext(0->18446744073709551615) 00002000:00010000:3.0:1789264226.170411:0:8409:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c398374df80. 00000100:00100000:3.0:1789264226.243932:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.244238:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311182592 00000100:00100000:0.0:1789264226.244249:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311182592 00000100:00100000:0.0:1789264226.244311:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 101 00000100:00100000:0.0:1789264226.244321:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+30:11308:x1876179311182592:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:0.0:1789264226.244389:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed72df lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244406:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed72df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244417:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed72df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244432:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed72e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244439:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed72e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244445:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed72e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244509:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed72ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244527:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed72ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244535:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed72ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789264226.244596:0:7904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed72ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244607:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed72df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244614:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed72df lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244621:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed72df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244627:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ae00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.244631:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed72df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244639:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed72df lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244651:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:0.0:1789264226.244654:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.244658:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed72df lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244664:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed72df lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244676:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed72e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244682:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed72e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244694:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed72e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244699:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366bc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.244703:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed72e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244710:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed72e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244718:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c39824a1100) 00010000:00010000:0.0:1789264226.244720:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.244723:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed72e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244728:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed72e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244799:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed72ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244807:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed72ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244814:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed72ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244819:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.244822:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed72ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244840:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed72ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244849:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:0.0:1789264226.244852:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.244854:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed72ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.244859:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed72ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264226.244935:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+30:11308:x1876179311182592:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 613us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264226.244943:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 101 00000100:00100000:0.0:1789264226.257871:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.257925:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264226.257945:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311182848 00000100:00100000:1.0:1789264226.257956:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311182848 00000100:00100000:1.0:1789264226.258018:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:1.0:1789264226.258028:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2405:x1876179311182848:12345-192.168.203.44@tcp:16:kworker.0 00000100:00100000:2.0:1789264226.258056:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311182720 00000100:00100000:2.0:1789264226.258063:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311182720 00002000:00100000:2.0:1789264226.258094:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->7) req@ffff9c3abaa93480 x1876179311182720/t0(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:307/0 lens 496/0 e 0 to 0 dl 1789264237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789264226.258104:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3abaa93480 with x1876179311182720 ext(0->7) 00002000:00010000:2.0:1789264226.258110:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c3abaa93480 00000100:00100000:2.0:1789264226.258138:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:2.0:1789264226.258147:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2405:x1876179311182720:12345-192.168.203.44@tcp:4:bash.0 00000100:00100000:2.0:1789264226.269491:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+11:2405:x1876179311182720:12345-192.168.203.44@tcp:4:bash.0 Request processed in 11334us (11554us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789264226.269508:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 2 00002000:00100000:2.0:1789264226.269536:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->7) req@ffff9c3abaa93480 x1876179311182720/t4294967308(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:307/0 lens 496/448 e 0 to 0 dl 1789264237 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789264226.269548:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3abaa93480 with x1876179311182720 ext(0->7) 00002000:00010000:2.0:1789264226.269555:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c3abaa93480 00000001:00080000:0.0:1789264226.274971:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1789264226.274985:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:1.0:1789264226.277076:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2405:x1876179311182848:12345-192.168.203.44@tcp:16:kworker.0 Request processed in 19039us (19203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264226.277089:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:0.0:1789264226.287781:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.289827:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311183104 00000100:00100000:2.0:1789264226.289844:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311183104 00000100:00100000:2.0:1789264226.289942:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 102 00000100:00100000:2.0:1789264226.289955:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+30:11311:x1876179311183104:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264226.289976:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264226.289999:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed72f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaba2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290072:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed72fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290104:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed72fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290116:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed72fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290147:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7302 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290156:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290163:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290281:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7309 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290290:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7309 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290297:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7309 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264226.290307:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789264226.290383:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed72fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290391:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed72fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290398:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed72fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290411:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264226.290415:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed72fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290422:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed72fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290435:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:2.0:1789264226.290438:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264226.290442:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed72fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290449:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622600/0xecaf9f2f14ed72fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290462:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290468:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7302 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290474:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7302 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290478:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264226.290481:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7302 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290487:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7302 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290504:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3aa98f2800) 00010000:00010000:2.0:1789264226.290507:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264226.290510:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7302 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290528:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7302 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290570:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623200/0xecaf9f2f14ed72f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaba2 expref: 33 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290584:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7309 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaba2 expref: 32 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.290592:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:2.0:1789264226.290594:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789264226.290596:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1d200, rc 0) 00000100:00100000:2.0:1789264226.290671:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+32:11311:x1876179311183104:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 719us (2939us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789264226.290679:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 102 00000100:00100000:0.0:1789264226.296333:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.296776:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311183232 00000100:00100000:2.0:1789264226.296786:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311183232 00000100:00100000:2.0:1789264226.296838:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 103 00000100:00100000:2.0:1789264226.296847:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ababbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+32:11311:x1876179311183232:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:2.0:1789264226.296911:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.296926:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab86 expref: 32 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.296948:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.296982:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab86 expref: 32 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.297002:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab86 expref: 32 pid: 9197 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264226.297016:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322778240:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264226.297128:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789264226.300199:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322778240:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264226.300230:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264226.304021:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.304137:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311183488 00000100:00100000:2.0:1789264226.304148:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311183488 00000100:00100000:2.0:1789264226.304221:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:2.0:1789264226.304232:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+33:6163:x1876179311183488:12345-192.168.203.44@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789264226.304509:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+34:6163:x1876179311183488:12345-192.168.203.44@tcp:35:ldlm_bl.0 Request processed in 278us (495us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789264226.304526:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:1.0:1789264226.306340:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.306446:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311183616 00000100:00100000:0.0:1789264226.306455:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311183616 00010000:00010000:0.0:1789264226.306488:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab86 expref: 34 pid: 9197 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264226.306539:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:0.0:1789264226.306549:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+34:2402:x1876179311183616:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264226.306572:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264226.306579:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab86 expref: 34 pid: 9197 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.306593:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab86 expref: 34 pid: 9197 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.306615:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623400/0xecaf9f2f14ed72ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab86 expref: 34 pid: 9197 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.306630:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:0.0:1789264226.306636:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.306646:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.306653:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.306692:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264226.306773:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+33:2402:x1876179311183616:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 196us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264226.306782:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 66 00010000:00010000:2.0:1789264226.308365:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.308380:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.308434:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.308442:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.308449:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.308456:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264226.308460:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.308468:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.308483:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:2.0:1789264226.308486:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789264226.308490:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.308497:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7317 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264226.308586:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ababbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+32:11311:x1876179311183232:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 11737us (12259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264226.308594:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 103 00000100:00100000:1.0:1789264226.313321:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.313400:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311183872 00000100:00100000:2.0:1789264226.313411:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311183872 00000100:00100000:2.0:1789264226.313461:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:2.0:1789264226.313486:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+32:11311:x1876179311183872:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:2.0:1789264226.313717:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+33:11311:x1876179311183872:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 233us (405us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789264226.313725:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:3.0:1789264226.392181:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.392363:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311184128 00000100:00100000:0.0:1789264226.392373:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311184128 00000100:00100000:0.0:1789264226.392428:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 104 00000100:00100000:0.0:1789264226.392438:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+33:11322:x1876179311184128:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:0.0:1789264226.392476:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264226.392495:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed731e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaba9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392588:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7325 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392603:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7325 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392614:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7325 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392627:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed732c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392634:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed732c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392641:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed732c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392803:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7333 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392814:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392822:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264226.392831:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1789264226.392914:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7325 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392935:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7325 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392941:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7325 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392949:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ae00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.392953:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7325 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392960:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7325 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392973:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:0.0:1789264226.392975:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.392980:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7325 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.392986:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7325 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.393000:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed732c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.393007:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed732c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.393013:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed732c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.393018:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366a000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.393028:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed732c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.393036:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed732c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.393045:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c39824a1200) 00010000:00010000:0.0:1789264226.393047:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.393050:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed732c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.393055:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed732c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.393100:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed731e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaba9 expref: 36 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.393114:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7333 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaba9 expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.393121:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:0.0:1789264226.393124:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789264226.393126:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366a200, rc 0) 00000100:00100000:0.0:1789264226.393175:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+35:11322:x1876179311184128:12345-192.168.203.44@tcp:101:cat.0 Request processed in 739us (1005us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789264226.393183:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 104 00000100:00100000:1.0:1789264226.398886:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.399041:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311184384 00000100:00100000:2.0:1789264226.399051:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311184384 00000100:00100000:2.0:1789264226.399105:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:2.0:1789264226.399127:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+35:11322:x1876179311184384:12345-192.168.203.44@tcp:35:cat.0 00000100:00100000:2.0:1789264226.399944:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+36:11322:x1876179311184384:12345-192.168.203.44@tcp:35:cat.0 Request processed in 825us (1062us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789264226.399953:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:1.0:1789264226.422987:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.423378:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311184640 00000100:00100000:2.0:1789264226.423388:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311184640 00000100:00100000:2.0:1789264226.423451:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 105 00000100:00100000:2.0:1789264226.423465:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+36:11323:x1876179311184640:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:2.0:1789264226.423532:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789264226.423562:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed72d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab94 expref: 36 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.423583:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7333 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaba9 expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.423595:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7309 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaba2 expref: 34 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.423607:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622200/0xecaf9f2f14ed72c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab8d expref: 33 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.423633:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:2.0:1789264226.423638:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789264226.423661:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7341 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.423673:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7341 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.423683:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7341 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.423697:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d600/0xecaf9f2f14ed7348 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.423703:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d600/0xecaf9f2f14ed7348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.423709:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d600/0xecaf9f2f14ed7348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.423807:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed734f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.423815:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed734f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.423819:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed734f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789264226.424017:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1789264226.424024:0:6490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306765279694ns, next at 307765277682ns, rc = 0 00010000:00010000:2.0:1789264226.424064:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7356 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424070:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7356 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424075:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7356 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424080:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7356 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424084:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7356 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424087:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7356 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424104:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264226.424117:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed734f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424120:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed734f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424124:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed734f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424127:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1dc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264226.424130:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed734f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424135:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed734f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.424145:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264226.424147:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:2.0:1789264226.424151:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789264226.424156:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7356 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424156:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed734f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424169:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed734f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.424174:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1ca00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264226.424181:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7356 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424182:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7341 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424197:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7341 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.424198:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7356 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424203:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7341 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424213:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264226.424215:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7341 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.424218:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:2.0:1789264226.424220:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7341 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.424225:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789264226.424230:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:3.0:1789264226.424231:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7356 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424233:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264226.424238:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7341 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.424243:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7356 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424248:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7341 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.424259:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264226.424261:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264226.424272:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1789264226.424276:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028b14118 reply state 00000000d60a8577 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d600/0xecaf9f2f14ed7348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424287:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d600/0xecaf9f2f14ed7348 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.424294:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3aa98f2800) 00010000:00010000:2.0:1789264226.424296:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789264226.424299:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789264226.424382:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+34:11323:x1876179311184640:12345-192.168.203.44@tcp:36:rm.0 Request processed in 921us (1401us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789264226.424390:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 105 00000100:00100000:3.0:1789264226.471116:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.471204:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311184896 00000100:00100000:2.0:1789264226.471214:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311184896 00000100:00100000:2.0:1789264226.471282:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 106 00000100:00100000:2.0:1789264226.471302:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+34:11329:x1876179311184896:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1789264226.471327:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264226.471350:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed735d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdabb0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.471482:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7364 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.471497:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7364 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.471510:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7364 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.471542:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed736b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.471551:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed736b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.471558:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed736b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789264226.472447:0:6491:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789264226.472617:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7372 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.472630:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7372 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.472638:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7372 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.472674:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7364 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.472681:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7364 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.472688:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7364 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.472694:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1dc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264226.472699:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7364 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.472720:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7364 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.472732:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:2.0:1789264226.472735:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264226.472739:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7364 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.472768:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7364 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789264226.472781:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a085b3be reply state 0000000017c3d175 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed736b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.472791:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed736b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.472796:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3aa98f2800) 00010000:00010000:2.0:1789264226.472799:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789264226.472802:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789264226.472833:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed735d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb0 expref: 37 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.472848:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7372 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb0 expref: 36 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.472854:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3aa98f2500) 00010000:00010000:2.0:1789264226.472856:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789264226.472859:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c200, rc 0) 00000100:00100000:2.0:1789264226.472929:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+37:11329:x1876179311184896:12345-192.168.203.44@tcp:101:bash.0 Request processed in 1638us (1827us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789264226.472942:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 106 00000100:00100000:1.0:1789264226.476176:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.476604:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311185024 00000100:00100000:0.0:1789264226.476614:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311185024 00000100:00100000:0.0:1789264226.476729:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:0.0:1789264226.476741:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2404:x1876179311185024:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1789264226.476790:0:11052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264226.476809:0:11052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7380 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdabb7 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789264226.476833:0:11052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264226.476852:0:11052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=306s v=(0 0) 00010000:00010000:0.0:1789264226.476856:0:11052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264226.476866:0:11052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7380 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb7 expref: 8 pid: 11052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.476885:0:11052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7380 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb7 expref: 8 pid: 11052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.476898:0:11052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366bc00, rc 0) 00000100:00100000:0.0:1789264226.476962:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2404:x1876179311185024:12345-192.168.203.44@tcp:101:bash.0 Request processed in 223us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264226.476969:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00080000:3.0:1789264226.477815:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264226.479291:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.479360:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311185152 00000100:00100000:2.0:1789264226.479369:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311185152 00000100:00100000:2.0:1789264226.479415:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:2.0:1789264226.479424:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+8:11329:x1876179311185152:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1789264226.479439:0:10317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264226.479454:0:10317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdabbe expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.479482:0:10317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7380 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb7 expref: 9 pid: 11052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.479491:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264226.479495:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264226.479501:0:10317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 9 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.479541:0:10317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7380 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb7 expref: 9 pid: 11052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.479553:0:10317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7380 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb7 expref: 9 pid: 11052 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264226.479567:0:10317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10317:1876179322778368:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264226.479650:0:10317:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264226.481983:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264226.482058:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311185280 00000100:00100000:3.0:1789264226.482068:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311185280 00010000:00010000:3.0:1789264226.482123:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7380 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb7 expref: 10 pid: 11052 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264226.482158:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:3.0:1789264226.482168:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+10:2402:x1876179311185280:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264226.482181:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264226.482201:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7380 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb7 expref: 10 pid: 11052 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.482213:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7380 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb7 expref: 10 pid: 11052 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.482236:0:7892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264226.482240:0:7892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264226.482247:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 10 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.482256:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 10 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.482300:0:7892:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 10 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264226.482334:0:7892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1876179322778496:192.168.203.44@tcp:105: 00000100:00100000:3.0:1789264226.482411:0:7892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fce40 going to sleep for 11 seconds 00010000:00010000:2.0:1789264226.483395:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7380 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb7 expref: 10 pid: 11052 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264226.483414:0:10317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10317:1876179322778368:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264226.483440:0:10317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 9 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.483452:0:10317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1da00, rc 0) 00000100:00100000:2.0:1789264226.483504:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+9:11329:x1876179311185152:12345-192.168.203.44@tcp:101:bash.0 Request processed in 4079us (4227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264226.483511:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:3.0:1789264226.487163:0:7892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1876179322778496:192.168.203.44@tcp:105: 00010000:00010000:3.0:1789264226.487192:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264226.487302:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311185280:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 5136us (5327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264226.487313:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:0.0:1789264226.488403:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.488491:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311185536 00000100:00100000:2.0:1789264226.488499:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311185536 00000100:00100000:2.0:1789264226.488557:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:2.0:1789264226.488568:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+37:11329:x1876179311185536:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:2.0:1789264226.488850:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+38:11329:x1876179311185536:12345-192.168.203.44@tcp:35:bash.0 Request processed in 283us (451us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789264226.488858:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:1.0:1789264226.620715:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264226.620826:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311185664 00000100:00100000:3.0:1789264226.620835:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311185664 00000100:00100000:3.0:1789264226.620898:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 107 00000100:00100000:3.0:1789264226.620908:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+38:11345:x1876179311185664:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1789264226.620931:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264226.620951:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed738e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdabc5 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.621012:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7395 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.621026:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.621037:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264226.621084:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789264226.621089:0:9197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264226.621236:0:9197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.621262:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed738e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabc5 expref: 40 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.621280:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7395 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabc5 expref: 39 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.621288:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:3.0:1789264226.621354:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789264226.621358:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a000, rc 0) 00000100:00100000:3.0:1789264226.621416:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+39:11345:x1876179311185664:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 510us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264226.621423:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 107 00000100:00100000:0.0:1789264226.628642:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.628782:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311185920 00000100:00100000:2.0:1789264226.628793:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311185920 00000100:00100000:2.0:1789264226.628852:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 108 00000100:00100000:2.0:1789264226.628861:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+39:11345:x1876179311185920:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264226.628882:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264226.628902:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed739c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdabcc expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.629038:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed73a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.629053:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed73a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.629064:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed73a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264226.629076:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789264226.629179:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed739c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabcc expref: 42 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.629197:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed73a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabcc expref: 41 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.629206:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3aa98f2500) 00010000:00010000:2.0:1789264226.629210:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789264226.629213:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1dc00, rc 0) 00000100:00100000:2.0:1789264226.629277:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+41:11345:x1876179311185920:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 417us (646us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1789264226.629284:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 108 00000100:00100000:1.0:1789264226.633001:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264226.633043:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264226.633412:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311186304 00000100:00100000:3.0:1789264226.633421:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311186304 00000100:00100000:3.0:1789264226.633486:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:3.0:1789264226.633497:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+41:2405:x1876179311186304:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264226.633521:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264226.633546:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed73a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabcc expref: 41 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.633567:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3aa98f2500) 00010000:00010000:3.0:1789264226.633572:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264226.633633:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+40:2405:x1876179311186304:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 138us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264226.633641:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:2.0:1789264226.634137:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311186176 00000100:00100000:2.0:1789264226.634144:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311186176 00000100:00100000:2.0:1789264226.634188:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 109 00000100:00100000:2.0:1789264226.634196:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+40:11345:x1876179311186176:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264226.634219:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264226.634244:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed73b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdabd3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.634348:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed73b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.634362:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed73b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.634374:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed73b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264226.634386:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789264226.634480:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed73b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabd3 expref: 43 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.634495:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed73b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabd3 expref: 42 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.634504:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3aa98f2500) 00010000:00010000:2.0:1789264226.634507:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789264226.634509:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1de00, rc 0) 00000100:00100000:2.0:1789264226.634568:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+42:11345:x1876179311186176:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 372us (1575us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1789264226.634575:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 109 00000100:00100000:1.0:1789264226.644260:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.647091:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311186432 00000100:00100000:0.0:1789264226.647107:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311186432 00000100:00100000:0.0:1789264226.647256:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:0.0:1789264226.647267:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2403:x1876179311186432:12345-192.168.203.44@tcp:1:lfs.0 00010000:00010000:0.0:1789264226.647487:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed73c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.647541:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 8 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.647550:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264226.647555:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789264226.647559:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed73c6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.647612:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 8 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.647627:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 8 pid: 10317 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264226.647642:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1876179322778624:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264226.647778:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c520c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264226.655693:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1876179322778624:192.168.203.44@tcp:104: 00010000:00010000:0.0:1789264226.657359:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed73c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264226.658825:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264226.659197:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311186560 00000100:00100000:3.0:1789264226.659208:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311186560 00002000:00100000:3.0:1789264226.659262:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9c39836ff800 x1876179311186560/t0(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:307/0 lens 504/0 e 0 to 0 dl 1789264237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789264226.659272:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c39836ff800 with x1876179311186560 ext(0->8) 00010000:00010000:3.0:1789264226.659280:0:8409:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 9 pid: 10317 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.659358:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 9 pid: 10317 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789264226.659365:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c39836ff800 00000100:00100000:3.0:1789264226.659400:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:3.0:1789264226.659411:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2404:x1876179311186560:12345-192.168.203.44@tcp:4:lfs.0 00000100:00100000:2.0:1789264226.660971:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+11:2404:x1876179311186560:12345-192.168.203.44@tcp:4:lfs.0 Request processed in 1554us (2147us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789264226.660984:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 1 00002000:00100000:2.0:1789264226.660994:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9c39836ff800 x1876179311186560/t4294967303(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:307/0 lens 504/448 e 0 to 0 dl 1789264237 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789264226.661016:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c39836ff800 with x1876179311186560 ext(0->8) 00010000:00010000:2.0:1789264226.661025:0:8409:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 11 pid: 10317 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.661041:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 11 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789264226.661047:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c39836ff800 00000100:00100000:1.0:1789264226.663971:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264226.664659:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311186688 00000100:00100000:3.0:1789264226.664668:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311186688 00010000:00010000:3.0:1789264226.664706:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 11 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264226.664768:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:3.0:1789264226.664778:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+11:2404:x1876179311186688:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264226.664792:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789264226.664809:0:6477:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789264226.664812:0:6477:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789264226 00002000:00010000:3.0:1789264226.664815:0:6477:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789264226 00002000:00010000:3.0:1789264226.664817:0:6477:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789264226 00002000:00010000:3.0:1789264226.664826:0:6477:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789264226.664833:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 11 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.664846:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 11 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.664872:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7387 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabbe expref: 11 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.664889:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1789264226.664893:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789264226.664899:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed73c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.664910:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed73c6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.665062:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264226.665128:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+10:2404:x1876179311186688:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 351us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264226.665136:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 68 00010000:00010000:2.0:1789264226.666384:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed73c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.666398:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed73c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.666424:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed73c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.666433:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed73c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.666442:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed73c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.666450:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366a200 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264226.666454:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed73c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.666475:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed73c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.666493:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed73c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789264226.666495:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:2.0:1789264226.666505:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfb5a9ab/0xecaf9f2f14ed73c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789264226.666510:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1789264226.666648:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2403:x1876179311186432:12345-192.168.203.44@tcp:1:lfs.0 Request processed in 19380us (22395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264226.666657:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:1.0:1789264226.669346:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.669609:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311186944 00000100:00100000:2.0:1789264226.669619:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311186944 00000100:00100000:2.0:1789264226.669686:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:2.0:1789264226.669697:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab27a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+42:11345:x1876179311186944:12345-192.168.203.44@tcp:35:lfs.0 00000004:00010000:2.0:1789264226.670031:0:6494:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed73b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabd3 expref: 42 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789264226.670213:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1789264226.670247:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789264226.670572:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1789264226.670907:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.670997:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7372 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb0 expref: 46 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.671013:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.671048:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7372 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb0 expref: 46 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.671063:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7372 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb0 expref: 46 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264226.671077:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1876179322778752:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264226.671216:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789264226.675899:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1876179322778752:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264226.675933:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264226.676644:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264226.676711:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311187072 00000100:00100000:3.0:1789264226.676718:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311187072 00010000:00010000:3.0:1789264226.676894:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7372 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb0 expref: 47 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264226.677016:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:2.0:1789264226.677027:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+47:2402:x1876179311187072:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264226.677041:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264226.677049:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7372 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb0 expref: 47 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.677060:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7372 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb0 expref: 47 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.677080:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7372 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabb0 expref: 47 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.677102:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3aa98f2500) 00010000:00010000:2.0:1789264226.677107:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.677131:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.677139:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.677170:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264226.677226:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+46:2402:x1876179311187072:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 201us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264226.677234:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 69 00010000:00010000:0.0:1789264226.677302:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.677310:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789264226.677420:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1789264226.677551:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1789264226.677637:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaced880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876179322778880:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789264226.677684:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264226.677719:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52840 going to sleep for 11 seconds 00000100:00100000:2.0:1789264226.678167:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322778880 00000100:00100000:2.0:1789264226.678173:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322778880 00000100:00100000:2.0:1789264226.678393:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789264226.678403:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6494:x1876179322778880:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789264226.678495:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6494:x1876179322778880:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264226.678501:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789264226.679160:0:6494:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1789264226.679167:0:6494:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:1.0:1789264226.679188:0:6494:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c3983113480, transno 4294967302 00000100:00100000:1.0:1789264226.679209:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaced880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876179322778880:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789264226.679340:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1789264226.679406:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876179322779008:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789264226.679446:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264226.679477:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c22000 going to sleep for 11 seconds 00000100:00100000:2.0:1789264226.679536:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322779008 00000100:00100000:2.0:1789264226.679541:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322779008 00000100:00100000:2.0:1789264226.679585:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789264226.679593:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6494:x1876179322779008:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789264226.679714:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6494:x1876179322779008:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 121us (266us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789264226.679733:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789264226.680529:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876179322779008:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789264226.680588:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789264226.680635:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.680644:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.680662:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.680669:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264226.680673:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.680681:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.680697:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3aa98f2500) 00010000:00010000:1.0:1789264226.680701:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789264226.680705:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.680711:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed73cd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789264226.680859:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789264226.680913:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1789264226.680924:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307022179404ns, next at 308022176754ns, rc = 0 00000001:00080000:1.0:1789264226.680930:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1789264226.680950:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3aa98f2500) 00010000:00010000:1.0:1789264226.680953:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789264226.680959:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed73b8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabd3 expref: 50 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264226.681058:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab27a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+49:11345:x1876179311186944:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 11363us (11720us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789264226.681077:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 26 00000020:00080000:1.0:1789264226.681081:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1789264226.681711:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264226.687012:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264226.687196:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311187200 00000100:00100000:3.0:1789264226.687205:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311187200 00000100:00100000:3.0:1789264226.687260:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 110 00000100:00100000:3.0:1789264226.687269:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+49:11345:x1876179311187200:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1789264226.687289:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264226.687310:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed73d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdabda expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.687363:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed73d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabda expref: 50 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.687377:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed73d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabda expref: 50 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.687395:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:3.0:1789264226.687398:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789264226.687401:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b600, rc 0) 00000100:00100000:3.0:1789264226.687462:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+50:11345:x1876179311187200:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 193us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264226.687469:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 110 00000100:00100000:2.0:1789264226.690615:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264226.690725:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311187456 00000100:00100000:3.0:1789264226.690734:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311187456 00000100:00100000:2.0:1789264226.694115:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:2.0:1789264226.694134:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+50:11345:x1876179311187456:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:2.0:1789264226.694448:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+51:11345:x1876179311187456:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 320us (3838us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789264226.694455:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:1.0:1789264226.788997:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.789104:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311187584 00000100:00100000:0.0:1789264226.789115:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311187584 00000100:00100000:0.0:1789264226.789183:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 111 00000100:00100000:0.0:1789264226.789194:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+51:11355:x1876179311187584:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:0.0:1789264226.789285:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73db lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789303:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789315:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789340:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789347:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789355:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789426:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed73e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789456:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed73e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789463:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed73e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789264226.789526:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed73e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789538:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789544:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73db lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789551:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789557:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.789561:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789569:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73db lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789579:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:0.0:1789264226.789582:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.789587:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789593:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789615:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789622:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789628:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789632:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.789634:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789641:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789649:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3aa98f2800) 00010000:00010000:0.0:1789264226.789651:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.789654:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789660:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789670:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed73e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789676:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed73e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789681:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed73e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789694:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366a200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.789698:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed73e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789703:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed73e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789712:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:0.0:1789264226.789714:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.789717:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed73e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.789723:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed73e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264226.790018:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+51:11355:x1876179311187584:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 825us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264226.790026:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 111 00000100:00100000:1.0:1789264226.845194:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.845302:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311187840 00000100:00100000:0.0:1789264226.845312:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311187840 00000100:00100000:0.0:1789264226.845392:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 112 00000100:00100000:0.0:1789264226.845402:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+51:11358:x1876179311187840:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264226.845421:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264226.845443:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed73f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdabe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845525:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845557:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845579:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845594:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845602:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845610:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845714:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7405 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845723:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7405 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845731:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7405 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264226.845780:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789264226.845863:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845872:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73f7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845879:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845892:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.845896:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845904:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845916:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:0.0:1789264226.845919:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.845924:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845929:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed73f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845943:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845949:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845954:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845959:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264226.845961:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845967:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845985:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3aa98f2800) 00010000:00010000:0.0:1789264226.845987:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264226.845990:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.845997:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed73fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.846034:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed73f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe1 expref: 54 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.846048:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7405 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe1 expref: 53 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.846054:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:0.0:1789264226.846056:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789264226.846058:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366a000, rc 0) 00000100:00100000:0.0:1789264226.846116:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+53:11358:x1876179311187840:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 716us (931us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789264226.846123:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 112 00000100:00100000:1.0:1789264226.849857:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.850073:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311187968 00000100:00100000:2.0:1789264226.850082:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311187968 00000100:00100000:2.0:1789264226.850144:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 113 00000100:00100000:2.0:1789264226.850153:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+53:11358:x1876179311187968:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:2.0:1789264226.850217:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7413 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.850233:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.850245:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.850280:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.850287:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7413 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.850295:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.850319:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264226.850324:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.850331:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7413 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.850353:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:2.0:1789264226.850356:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789264226.850361:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7413 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.850368:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed7413 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264226.850440:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+53:11358:x1876179311187968:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 288us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264226.850448:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 113 00000100:00100000:1.0:1789264226.855165:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.855217:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311188224 00000100:00100000:2.0:1789264226.855227:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311188224 00000100:00100000:2.0:1789264226.855289:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:2.0:1789264226.855300:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+53:11358:x1876179311188224:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:2.0:1789264226.855609:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+54:11358:x1876179311188224:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 311us (454us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789264226.855618:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:1.0:1789264226.926834:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.926902:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311188480 00000100:00100000:2.0:1789264226.926912:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311188480 00000100:00100000:2.0:1789264226.926978:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 114 00000100:00100000:2.0:1789264226.927003:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+54:11368:x1876179311188480:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1789264226.927026:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264226.927029:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789264226.927052:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7395 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabc5 expref: 54 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.927072:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:2.0:1789264226.927077:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789264226.927091:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed741a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdabe8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.927185:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.927198:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7405 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe1 expref: 54 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.927206:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.927239:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7405 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe1 expref: 54 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.927252:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7405 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe1 expref: 54 pid: 6490 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264226.927264:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322779136:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264226.927377:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264226.930083:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.930194:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322779136:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264226.930224:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264226.931035:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311188608 00000100:00100000:0.0:1789264226.931044:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311188608 00010000:00010000:0.0:1789264226.931079:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7405 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe1 expref: 55 pid: 6490 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264226.931150:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:0.0:1789264226.931159:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+55:2402:x1876179311188608:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264226.931188:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264226.931195:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7405 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe1 expref: 55 pid: 6490 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.931207:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7405 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe1 expref: 55 pid: 6490 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.931229:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7405 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe1 expref: 55 pid: 6490 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.931244:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:0.0:1789264226.931248:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.931258:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.931265:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.931372:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264226.931428:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+54:2402:x1876179311188608:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 270us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264226.931437:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 70 00010000:00010000:2.0:1789264226.932963:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.932978:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264226.932997:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789264226.933125:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed741a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe8 expref: 55 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.933142:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe8 expref: 54 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.933151:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:2.0:1789264226.933154:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789264226.933157:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1d800, rc 0) 00000100:00100000:2.0:1789264226.933257:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+54:11368:x1876179311188480:12345-192.168.203.44@tcp:101:bash.0 Request processed in 6255us (6432us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789264226.933265:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 114 00000100:00100000:1.0:1789264226.935251:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264226.935569:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311188736 00000100:00100000:3.0:1789264226.935578:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311188736 00000100:00100000:3.0:1789264226.935633:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 115 00000100:00100000:3.0:1789264226.935642:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+54:11368:x1876179311188736:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1789264226.935671:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264226.935691:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed742f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdabef expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.935723:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7436 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.935737:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7436 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.935906:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7436 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.936016:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed742f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabef expref: 56 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.936034:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7436 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabef expref: 55 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264226.936043:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:3.0:1789264226.936045:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789264226.936048:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a600, rc 0) 00000100:00100000:3.0:1789264226.937228:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+55:11368:x1876179311188736:12345-192.168.203.44@tcp:101:bash.0 Request processed in 466us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264226.937239:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 115 00000100:00100000:1.0:1789264226.952098:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00010000:00010000:1.0:1789264226.954061:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264226.956600:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311188992 00000100:00100000:2.0:1789264226.956613:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311188992 00000100:00100000:2.0:1789264226.956685:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 116 00000100:00100000:2.0:1789264226.956694:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+55:11368:x1876179311188992:12345-192.168.203.44@tcp:36:bash.0 00010000:00010000:2.0:1789264226.956911:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed743d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.956938:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed743d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.956950:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed743d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789264226.956987:0:7904:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1789264226.957006:0:7904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003df4892a reply state 000000008f85a1cd transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed743d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.957018:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed743d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.957025:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:2.0:1789264226.957028:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789264226.957031:0:7904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789264226.957107:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+58:11368:x1876179311188992:12345-192.168.203.44@tcp:36:bash.0 Request processed in 413us (5017us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789264226.957114:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 116 00000020:00080000:2.0:1789264226.957118:0:7904:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789264226.960651:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264226.960782:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311189120 00000100:00100000:2.0:1789264226.960792:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311189120 00000100:00100000:2.0:1789264226.960840:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 117 00000100:00100000:2.0:1789264226.960850:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+58:11368:x1876179311189120:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1789264226.960872:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264226.960895:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d400/0xecaf9f2f14ed7444 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdabf6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.960983:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.961010:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe8 expref: 59 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.961019:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.961053:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe8 expref: 59 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264226.961066:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe8 expref: 59 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264226.961078:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322779264:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264226.961211:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264226.965708:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322779264:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264226.965739:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264226.966795:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.967673:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311189248 00000100:00100000:0.0:1789264226.967684:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311189248 00010000:00010000:0.0:1789264226.968237:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe8 expref: 60 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264226.968551:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 71 00000100:00100000:0.0:1789264226.968567:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+60:2403:x1876179311189248:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264226.968716:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264226.968725:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe8 expref: 60 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.968796:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe8 expref: 60 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.968820:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7421 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabe8 expref: 60 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.968986:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:0.0:1789264226.968992:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.969000:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.969006:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264226.969044:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264226.969108:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+59:2403:x1876179311189248:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 545us (2316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264226.969116:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 71 00010000:00010000:1.0:1789264226.970036:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.970047:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264226.970113:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789264226.970118:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789264226.970139:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.970173:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d400/0xecaf9f2f14ed7444 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabf6 expref: 59 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.970190:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabf6 expref: 58 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264226.970211:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:1.0:1789264226.970214:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789264226.970217:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c800, rc 0) 00000100:00100000:1.0:1789264226.970267:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+58:11368:x1876179311189120:12345-192.168.203.44@tcp:101:bash.0 Request processed in 9417us (9625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264226.970275:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 117 00000100:00100000:1.0:1789264226.973159:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264226.973424:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311189504 00000100:00100000:0.0:1789264226.973446:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311189504 00000100:00100000:0.0:1789264226.973508:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:0.0:1789264226.973527:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+58:11368:x1876179311189504:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:0.0:1789264226.974138:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+59:11368:x1876179311189504:12345-192.168.203.44@tcp:35:bash.0 Request processed in 609us (986us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1789264226.974147:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:0.0:1789264227.047861:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264227.048063:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311189632 00000100:00100000:3.0:1789264227.048072:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311189632 00000100:00100000:3.0:1789264227.048135:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 118 00000100:00100000:3.0:1789264227.048146:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+59:11374:x1876179311189632:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1789264227.048192:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264227.048215:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7452 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdabfd expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.048294:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7459 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.048309:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7459 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.048321:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7459 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264227.048365:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789264227.048369:0:9197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264227.048386:0:9197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7459 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.048409:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabfd expref: 61 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.048427:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7459 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabfd expref: 60 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.048435:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:3.0:1789264227.048437:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789264227.048441:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a800, rc 0) 00000100:00100000:3.0:1789264227.048740:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11374:x1876179311189632:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 594us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.048795:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 118 00000100:00100000:3.0:1789264227.057685:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.059258:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311189760 00000100:00100000:0.0:1789264227.059273:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311189760 00000100:00100000:0.0:1789264227.059345:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 119 00000100:00100000:0.0:1789264227.059356:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11374:x1876179311189760:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264227.059375:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264227.059396:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7460 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac04 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059456:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7467 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059469:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7467 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059480:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7467 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059490:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed746e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059497:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed746e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059678:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed746e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059785:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7475 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059794:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059800:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264227.059839:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789264227.059843:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789264227.059860:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059871:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059879:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7467 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059884:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7467 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059890:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7467 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059895:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.059899:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7467 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059913:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7467 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059924:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:0.0:1789264227.059927:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264227.059931:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7467 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059937:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7467 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059951:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed746e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059956:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed746e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059962:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed746e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059967:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.059969:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed746e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059975:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed746e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059981:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3aa98f2800) 00010000:00010000:0.0:1789264227.059983:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264227.059985:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed746e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.059999:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed746e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.060026:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7460 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac04 expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.060039:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7475 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac04 expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.060046:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:0.0:1789264227.060049:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789264227.060051:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366ae00, rc 0) 00000100:00100000:0.0:1789264227.061309:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11374:x1876179311189760:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1947us (3625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264227.061319:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 119 00000100:00100000:1.0:1789264227.072925:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264227.073029:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311189888 00000100:00100000:2.0:1789264227.073039:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311189888 00000100:00100000:2.0:1789264227.073115:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:2.0:1789264227.073125:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+61:2404:x1876179311189888:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264227.073143:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264227.073167:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed7475 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac04 expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.073206:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:2.0:1789264227.073211:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264227.073267:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+60:2404:x1876179311189888:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 143us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264227.073275:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:1.0:1789264227.083560:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264227.083652:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311190144 00000100:00100000:2.0:1789264227.083662:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311190144 00000100:00100000:2.0:1789264227.083737:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 120 00000100:00100000:2.0:1789264227.083770:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11374:x1876179311190144:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264227.083790:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264227.083810:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed747c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac0b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.083917:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.083933:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabf6 expref: 61 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.083940:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.083973:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabf6 expref: 61 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.083986:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabf6 expref: 61 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264227.084020:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322779392:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264227.084122:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264227.087901:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.087970:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311190272 00000100:00100000:0.0:1789264227.087980:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311190272 00010000:00010000:0.0:1789264227.088019:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabf6 expref: 62 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264227.088073:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 72 00000100:00100000:0.0:1789264227.088084:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+62:2402:x1876179311190272:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264227.088102:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789264227.088104:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322779392:192.168.203.44@tcp:104: 00010000:00010000:0.0:1789264227.088112:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabf6 expref: 62 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.088142:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.088153:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabf6 expref: 62 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.091502:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed744b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabf6 expref: 62 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.091542:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:0.0:1789264227.091547:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.091559:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.091568:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.091613:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264227.091776:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+61:2402:x1876179311190272:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 3649us (3838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264227.091787:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 72 00010000:00010000:2.0:1789264227.092023:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.092042:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264227.092062:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789264227.092261:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed747c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac0b expref: 62 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.092279:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac0b expref: 61 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.092286:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:2.0:1789264227.092289:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789264227.092292:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1cc00, rc 0) 00000100:00100000:2.0:1789264227.092333:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11374:x1876179311190144:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 8577us (8774us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789264227.092340:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 120 00000100:00100000:1.0:1789264227.096944:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264227.097838:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311190528 00000100:00100000:2.0:1789264227.097864:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311190528 00000100:00100000:2.0:1789264227.097988:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:2.0:1789264227.097999:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11374:x1876179311190528:12345-192.168.203.44@tcp:103:lfs.0 00010000:00010000:2.0:1789264227.098015:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264227.098052:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed73d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabda expref: 61 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.098070:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:2.0:1789264227.098074:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264227.098557:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11374:x1876179311190528:12345-192.168.203.44@tcp:103:lfs.0 Request processed in 557us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264227.098565:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:1.0:1789264227.107086:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264227.107546:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311190656 00000100:00100000:3.0:1789264227.107556:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311190656 00000100:00100000:3.0:1789264227.107618:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 121 00000100:00100000:3.0:1789264227.107628:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11374:x1876179311190656:12345-192.168.203.44@tcp:58:lfs.0 00010000:00010000:3.0:1789264227.107783:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7491 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.107798:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7491 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.107808:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7491 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789264227.107898:0:9197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789264227.107965:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11374:x1876179311190656:12345-192.168.203.44@tcp:58:lfs.0 Request processed in 339us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.107972:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 121 00000100:00100000:1.0:1789264227.110303:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.110386:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311190784 00000100:00100000:0.0:1789264227.110395:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311190784 00000100:00100000:0.0:1789264227.110454:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 122 00000100:00100000:0.0:1789264227.110464:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+60:11374:x1876179311190784:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264227.110481:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264227.110501:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7498 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac12 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.110647:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7491 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.110658:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7498 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac12 expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.110678:0:6490:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7491 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.110691:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7498 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac12 expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.110704:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:0.0:1789264227.110707:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789264227.110711:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7498 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac12 expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.110719:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366a200, rc 0) 00000100:00100000:0.0:1789264227.111344:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11374:x1876179311190784:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 878us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264227.111352:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 122 00000040:00080000:3.0:1789264227.338295:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789264227.338302:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789264227.338339:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000100:00100000:0.0:1789264227.338343:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322779520:0@lo:400:kworker.0 00000040:00080000:3.0:1789264227.338351:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789264227.338416:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264227.338466:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322780032:0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.338468:0:13760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13760:1876179322781184:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789264227.338524:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322779776:0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.338543:0:13760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264227.338715:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264227.338741:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322780544:0@lo:400:kworker.0 00000100:00100000:2.0:1789264227.338856:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264227.338877:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322780288:0@lo:400:kworker.0 00000100:00100000:2.0:1789264227.338904:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264227.338921:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322780800:0@lo:400:kworker.0 00000100:00100000:2.0:1789264227.338941:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264227.338961:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789264227.338967:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322779904:0@lo:400:kworker.0 00000100:00100000:2.0:1789264227.338989:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264227.339007:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322780416:0@lo:400:kworker.0 00000100:00100000:2.0:1789264227.339154:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264227.341651:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322779520 00000100:00100000:1.0:1789264227.341667:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322779520 00000100:00100000:1.0:1789264227.341726:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789264227.341736:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab563b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322779520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.342995:0:13760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13760:1876179322781184:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789264227.343100:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322780288 00000100:00100000:3.0:1789264227.343107:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322780288 00000100:00100000:3.0:1789264227.343156:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322780800 00000100:00100000:3.0:1789264227.343171:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322780800 00000100:00100000:3.0:1789264227.343189:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322779904 00000100:00100000:3.0:1789264227.343192:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322779904 00000100:00100000:3.0:1789264227.343204:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322780416 00000100:00100000:3.0:1789264227.343206:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322780416 00000100:00100000:3.0:1789264227.343222:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789264227.343229:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322780288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.343284:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322780288:12345-0@lo:400:kworker.0 Request processed in 55us (4379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.343291:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789264227.343306:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789264227.343312:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39837f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322780800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.343340:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39837f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322780800:12345-0@lo:400:kworker.0 Request processed in 28us (4398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.343345:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789264227.343356:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789264227.343361:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322779904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.343387:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322779904:12345-0@lo:400:kworker.0 Request processed in 27us (4397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.343393:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789264227.343403:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789264227.343409:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322780416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.343434:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322780416:12345-0@lo:400:kworker.0 Request processed in 25us (4280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.343439:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789264227.343489:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322780032 00000100:00100000:3.0:1789264227.343493:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322780032 00000100:00100000:3.0:1789264227.343538:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322779776 00000100:00100000:3.0:1789264227.343541:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322779776 00000100:00100000:3.0:1789264227.343554:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789264227.343560:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322780032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.343593:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322780032:12345-0@lo:400:kworker.0 Request processed in 33us (4878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.343599:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789264227.343611:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789264227.343616:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322779776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.343645:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322779776:12345-0@lo:400:kworker.0 Request processed in 29us (4790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.343650:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1789264227.343688:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789264227.343692:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789264227.343722:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322779648:0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.343784:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264227.343808:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398364fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322780160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264227.343836:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264227.343860:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322780672:0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.343881:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264227.343896:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322781312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789264227.344144:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264227.344176:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322779648 00000100:00100000:3.0:1789264227.344180:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322779648 00000100:00100000:3.0:1789264227.344205:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322780672 00000100:00100000:3.0:1789264227.344209:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322780672 00000100:00100000:0.0:1789264227.344214:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264227.344241:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789264227.344256:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322779648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.344293:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322779648:12345-0@lo:400:kworker.0 Request processed in 37us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.344299:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789264227.344328:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322779648:0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.344350:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789264227.344357:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322780672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.344390:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322780672:12345-0@lo:400:kworker.0 Request processed in 33us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.344396:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789264227.344418:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322780672:0@lo:400:kworker.0 00000100:00080000:3.0:1789264227.344434:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789264227.344461:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322780160 00000100:00100000:3.0:1789264227.344464:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322780160 00000100:00100000:3.0:1789264227.344499:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322781312 00000100:00100000:3.0:1789264227.344502:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322781312 00000100:00100000:2.0:1789264227.344539:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789264227.344557:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322781056:0@lo:400:kworker.0 00000100:00100000:2.0:1789264227.344589:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322780160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789264227.344613:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264227.344629:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789264227.344640:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322781312:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264227.344654:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322780160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (815us total) trans 0 rc 0/0 00002000:00000024:3.0:1789264227.344655:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264227.344665:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789264227.344704:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398364fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322780160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789264227.344820:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322780544 00000100:00100000:0.0:1789264227.344824:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322780544 00000100:00100000:0.0:1789264227.344852:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789264227.344858:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322780544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.345091:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322781312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 452us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.345099:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1789264227.345115:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789264227.345118:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789264227.345147:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983727800 x1876179322780416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264227.345171:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322780416:0@lo:400:kworker.0 00000100:00100000:2.0:1789264227.345180:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000100:00100000:3.0:1789264227.345181:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322780928:0@lo:400:kworker.0 00000004:00080000:2.0:1789264227.345188:0:3625:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1789264227.345213:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322781312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789264227.345220:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264227.345252:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322779776:0@lo:400:kworker.0 00000100:00100000:2.0:1789264227.345264:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322780928 00000100:00100000:3.0:1789264227.345268:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322780288:0@lo:400:kworker.0 00000100:00100000:2.0:1789264227.345269:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322780928 00010000:00080000:3.0:1789264227.345285:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983c8aa00 x1876179322780800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264227.345295:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322780800:0@lo:400:kworker.0 00000100:00100000:2.0:1789264227.345304:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789264227.345313:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322780928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.345326:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322779904:0@lo:400:kworker.0 00000100:00100000:2.0:1789264227.345359:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322780928:12345-0@lo:400:kworker.0 Request processed in 48us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264227.345366:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789264227.345371:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322780928:0@lo:400:kworker.0 00000100:00100000:2.0:1789264227.345492:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.345662:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322780544:12345-0@lo:400:kworker.0 Request processed in 802us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264227.345668:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789264227.345705:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264227.345846:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322781056 00000100:00100000:2.0:1789264227.345851:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322781056 00000100:00100000:2.0:1789264227.345875:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789264227.345882:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322781056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264227.345917:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322781056:12345-0@lo:400:kworker.0 Request processed in 35us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264227.345922:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789264227.345984:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322780032:0@lo:400:kworker.0 00000100:00100000:0.0:1789264227.346002:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322780544:0@lo:400:kworker.0 00000100:00100000:0.0:1789264227.346010:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322781056:0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.347140:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311190912 00000100:00100000:3.0:1789264227.347150:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311190912 00000100:00100000:3.0:1789264227.347211:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 123 00000100:00100000:3.0:1789264227.347220:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11375:x1876179311190912:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789264227.347246:0:6492:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789264227.347362:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11375:x1876179311190912:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 142us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.347369:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 123 00000100:00100000:1.0:1789264227.351483:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab563b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3624:x1876179322779520:12345-0@lo:400:kworker.0 Request processed in 9740us (13058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264227.351497:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789264227.351626:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322779520:0@lo:400:kworker.0 00000100:00100000:3.0:1789264227.356577:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.358037:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311191040 00000100:00100000:0.0:1789264227.358051:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311191040 00000100:00100000:0.0:1789264227.358126:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 124 00000100:00100000:0.0:1789264227.358137:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11375:x1876179311191040:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789264227.358210:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed749f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358226:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed749f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358238:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed749f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358269:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74a6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358277:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358284:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358306:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358314:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358321:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264227.358366:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789264227.358370:0:9197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789264227.358384:0:9197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358395:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed749f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358401:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed749f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358408:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed749f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358424:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.358428:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed749f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358434:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed749f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358446:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e7c300) 00010000:00010000:0.0:1789264227.358449:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264227.358453:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed749f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358458:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed749f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358472:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358476:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74a6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358481:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358485:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366bc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.358488:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358494:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74a6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358521:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9c398249fe00) 00010000:00010000:0.0:1789264227.358524:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264227.358526:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74a6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358531:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74a6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358545:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358551:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358556:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358562:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.358565:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358571:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358577:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:0.0:1789264227.358579:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264227.358582:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.358587:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264227.358678:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11375:x1876179311191040:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 Request processed in 541us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264227.358687:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 124 00000100:00100000:0.0:1789264227.362783:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264227.362873:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311191296 00000100:00100000:3.0:1789264227.362882:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311191296 00000100:00100000:3.0:1789264227.362947:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 125 00000100:00100000:3.0:1789264227.362973:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+61:11375:x1876179311191296:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789264227.362993:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264227.363012:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed74b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac19 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.363136:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.363149:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.363160:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264227.363170:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789264227.363244:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.363252:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.363259:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.363265:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36bc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264227.363269:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.363276:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.363288:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:3.0:1789264227.363297:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789264227.363302:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.363307:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.363346:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed74b4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac19 expref: 63 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.363355:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e7c300) 00010000:00010000:3.0:1789264227.363357:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789264227.363361:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed74b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac19 expref: 63 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.363371:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36ac00, rc 0) 00000100:00100000:3.0:1789264227.363422:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+62:11375:x1876179311191296:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 451us (647us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1789264227.363429:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 125 00000100:00100000:2.0:1789264227.365834:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264227.365930:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311191424 00000100:00100000:3.0:1789264227.365948:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311191424 00000100:00100000:3.0:1789264227.365997:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 126 00000100:00100000:3.0:1789264227.366006:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abf56d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+62:11375:x1876179311191424:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789264227.366043:0:7904:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789264227.366159:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abf56d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+62:11375:x1876179311191424:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 152us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.366165:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 126 00000100:00100000:1.0:1789264227.373285:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264227.373363:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311191680 00000100:00100000:3.0:1789264227.373389:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311191680 00000100:00100000:3.0:1789264227.373451:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 127 00000100:00100000:3.0:1789264227.373461:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+62:11375:x1876179311191680:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789264227.373480:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264227.373483:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789264227.373518:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7459 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabfd expref: 62 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.373536:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:3.0:1789264227.373541:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789264227.373552:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed74c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac20 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789264227.373956:0:6490:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789264227.374114:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.374128:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.374138:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.374189:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed74c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac20 expref: 64 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.374203:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac20 expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.374223:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c3983364300) 00010000:00010000:3.0:1789264227.374225:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789264227.374228:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36bc00, rc 0) 00000100:00100000:3.0:1789264227.374285:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+63:11375:x1876179311191680:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 825us (1013us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789264227.374293:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 127 00000100:00100000:1.0:1789264227.380498:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.380601:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311191936 00000100:00100000:0.0:1789264227.380612:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311191936 00000100:00100000:0.0:1789264227.380673:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 128 00000100:00100000:0.0:1789264227.380683:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+63:11375:x1876179311191936:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789264227.380739:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264227.380802:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed74d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac20 expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.380822:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c3983364300) 00010000:00010000:0.0:1789264227.380831:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264227.381013:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74de lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381027:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381037:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381051:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xbeec6901 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381058:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbeec6901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381084:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbeec6901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381303:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381310:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74de lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381316:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381321:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.381325:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381332:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381340:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:0.0:1789264227.381343:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264227.381346:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74de lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381351:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed74de lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381360:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbeec6901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381365:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74e5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbeec6901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381376:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbeec6901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381381:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366bc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.381383:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbeec6901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381389:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74e5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbeec6901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381396:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xbeec6901 (ffff9c398249fe00) 00010000:00010000:0.0:1789264227.381399:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264227.381401:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74e5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xbeec6901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.381406:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74e5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xbeec6901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264227.381494:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+62:11375:x1876179311191936:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 811us (1002us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789264227.381502:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 128 00000100:00100000:1.0:1789264227.383663:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.383735:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311192064 00000100:00100000:0.0:1789264227.383767:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311192064 00000100:00100000:0.0:1789264227.383824:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 129 00000100:00100000:0.0:1789264227.383834:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+62:11375:x1876179311192064:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264227.383861:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264227.383883:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed74ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac27 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.383942:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed74f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.383956:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed74f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.383970:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed74f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.384074:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed74ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac27 expref: 64 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.384091:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed74f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac27 expref: 63 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.384100:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c398249f900) 00010000:00010000:0.0:1789264227.384271:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789264227.384275:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366ae00, rc 0) 00000100:00100000:0.0:1789264227.384333:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+63:11375:x1876179311192064:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 501us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264227.384340:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 129 00000100:00100000:1.0:1789264227.387373:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.387482:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311192320 00000100:00100000:0.0:1789264227.387492:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311192320 00000100:00100000:0.0:1789264227.387561:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 130 00000100:00100000:0.0:1789264227.387571:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+63:11375:x1876179311192320:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789264227.387668:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.387694:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.387706:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789264227.387900:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1789264227.387949:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027177d71 reply state 000000003f034b6d transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.387963:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.387971:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c398249f900) 00010000:00010000:0.0:1789264227.387974:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789264227.387977:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789264227.388064:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+65:11375:x1876179311192320:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 494us (700us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789264227.388071:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 130 00000100:00100000:1.0:1789264227.390470:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.390530:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311192448 00000100:00100000:0.0:1789264227.390539:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311192448 00000100:00100000:0.0:1789264227.390651:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 131 00000100:00100000:0.0:1789264227.390663:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+65:11375:x1876179311192448:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264227.390688:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264227.390709:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7501 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac2e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.390799:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7501 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac2e expref: 66 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.390840:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7501 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac2e expref: 66 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.390860:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c398249f900) 00010000:00010000:0.0:1789264227.390863:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789264227.390867:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366ac00, rc 0) 00000100:00100000:0.0:1789264227.390916:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+66:11375:x1876179311192448:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 255us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264227.390925:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 131 00000100:00100000:1.0:1789264227.392823:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264227.392980:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311192576 00000100:00100000:2.0:1789264227.392990:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311192576 00000100:00100000:2.0:1789264227.393046:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:2.0:1789264227.393055:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311192576:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789264227.393273:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2402:x1876179311192576:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 219us (457us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789264227.393290:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:1.0:1789264227.395667:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264227.395788:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311192832 00000100:00100000:2.0:1789264227.395796:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311192832 00000100:00100000:2.0:1789264227.395854:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:2.0:1789264227.395864:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+66:11375:x1876179311192832:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789264227.396088:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+67:11375:x1876179311192832:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 224us (427us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1789264227.396095:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:1.0:1789264227.398262:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.398350:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311193088 00000100:00100000:0.0:1789264227.398360:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311193088 00000100:00100000:0.0:1789264227.398416:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 132 00000100:00100000:0.0:1789264227.398426:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+67:11375:x1876179311193088:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789264227.398538:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+67:11375:x1876179311193088:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 112us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264227.398545:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 132 00000100:00100000:1.0:1789264227.400924:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264227.401003:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311193216 00000100:00100000:3.0:1789264227.401011:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311193216 00000100:00100000:3.0:1789264227.401074:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 133 00000100:00100000:3.0:1789264227.401084:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+67:11375:x1876179311193216:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789264227.401272:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264227.401301:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7508 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac35 expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.401370:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed750f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.401384:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed750f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.401395:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed750f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264227.401438:0:7904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264227.401457:0:7904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed750f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.401483:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7508 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac35 expref: 69 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.401520:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed750f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac35 expref: 68 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.401529:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c398249f900) 00010000:00010000:3.0:1789264227.401532:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789264227.401535:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a800, rc 0) 00000100:00100000:3.0:1789264227.401588:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+68:11375:x1876179311193216:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 505us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.401596:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 133 00000100:00100000:1.0:1789264227.404203:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.404296:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311193344 00000100:00100000:0.0:1789264227.404305:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311193344 00000100:00100000:0.0:1789264227.404359:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:0.0:1789264227.404370:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2403:x1876179311193344:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264227.404386:0:11052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264227.404407:0:11052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed7516 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac3c expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789264227.404432:0:11052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa60163, blocks: 0x0 00010000:00010000:0.0:1789264227.404465:0:11052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1789264227.404469:0:11052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264227.404479:0:11052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed7516 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac3c expref: 10 pid: 11052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.404495:0:11052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed7516 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac3c expref: 10 pid: 11052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.404518:0:11052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366b000, rc 0) 00000100:00100000:0.0:1789264227.404574:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+10:2403:x1876179311193344:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 205us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264227.404580:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:1.0:1789264227.407175:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.407270:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311193600 00000100:00100000:0.0:1789264227.407279:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311193600 00000100:00100000:0.0:1789264227.407382:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 134 00000100:00100000:0.0:1789264227.407392:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+68:11375:x1876179311193600:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789264227.407528:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+68:11375:x1876179311193600:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 137us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264227.407535:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 134 00000100:00100000:1.0:1789264227.410354:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264227.410451:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311193728 00000100:00100000:2.0:1789264227.410460:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311193728 00000100:00100000:2.0:1789264227.410557:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 48 00000100:00100000:2.0:1789264227.410568:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+10:11375:x1876179311193728:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789264227.410585:0:10317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264227.410606:0:10317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed751d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac43 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.410637:0:10317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed7516 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac3c expref: 11 pid: 11052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.410646:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264227.410650:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264227.410668:0:10317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed751d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac43 expref: 11 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.410703:0:10317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed7516 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac3c expref: 11 pid: 11052 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.410715:0:10317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed7516 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac3c expref: 11 pid: 11052 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264227.410728:0:10317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10317:1876179322781440:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264227.413570:0:10317:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264227.413608:0:10317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10317:1876179322781440:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264227.413638:0:10317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed751d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac43 expref: 11 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.413658:0:10317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c400, rc 0) 00000100:00100000:2.0:1789264227.413718:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+11:11375:x1876179311193728:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 3150us (3370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264227.413726:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 48 00000100:00100000:0.0:1789264227.414496:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264227.414958:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311193856 00000100:00100000:2.0:1789264227.414966:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311193856 00010000:00010000:2.0:1789264227.415000:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed7516 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac3c expref: 11 pid: 11052 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264227.415036:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 73 00000100:00100000:2.0:1789264227.415044:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+11:2403:x1876179311193856:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264227.415068:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264227.415097:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed7516 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac3c expref: 11 pid: 11052 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.415205:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed7516 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac3c expref: 11 pid: 11052 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.415230:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed7516 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac3c expref: 11 pid: 11052 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.415247:0:7892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264227.415251:0:7892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264227.415258:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed751d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac43 expref: 10 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.415268:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed751d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac43 expref: 10 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.415537:0:7892:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed751d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac43 expref: 10 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264227.415551:0:7892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39826a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1876179322781568:192.168.203.44@tcp:105: 00000100:00100000:2.0:1789264227.415836:0:7892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264227.423649:0:7892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39826a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1876179322781568:192.168.203.44@tcp:105: 00010000:00010000:2.0:1789264227.423677:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264227.423823:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+10:2403:x1876179311193856:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 8778us (9328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264227.423834:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 73 00000100:00100000:1.0:1789264227.425651:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264227.426388:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311193984 00000100:00100000:3.0:1789264227.426397:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311193984 00002000:00100000:3.0:1789264227.426443:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9c3983df4e00 x1876179311193984/t0(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:308/0 lens 504/0 e 0 to 0 dl 1789264238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789264227.426454:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3983df4e00 with x1876179311193984 ext(0->12) 00002000:00010000:3.0:1789264227.426460:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c3983df4e00 00000100:00100000:3.0:1789264227.426492:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:3.0:1789264227.426500:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+10:2403:x1876179311193984:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789264227.429722:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+12:2403:x1876179311193984:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 Request processed in 3211us (4067us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789264227.429735:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3 00002000:00100000:3.0:1789264227.429769:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9c3983df4e00 x1876179311193984/t4294967310(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:308/0 lens 504/448 e 0 to 0 dl 1789264238 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789264227.429780:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3983df4e00 with x1876179311193984 ext(0->12) 00002000:00010000:3.0:1789264227.429799:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c3983df4e00 00000100:00100000:2.0:1789264227.440267:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264227.441247:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311194112 00000100:00100000:3.0:1789264227.441258:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311194112 00000100:00100000:3.0:1789264227.441323:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 135 00000100:00100000:3.0:1789264227.441333:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39826a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+68:11375:x1876179311194112:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789264227.450906:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1789264227.450943:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789264227.450968:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c3983c22300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789264227.450973:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c39827afe00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c3983c22b40 00000020:00080000:1.0:1789264227.450976:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c39827af600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c39835e6a00 00000004:00080000:1.0:1789264227.451009:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789264227.451036:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c39825fc180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789264227.451038:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c39835b2400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c39825fc840 00000020:00080000:1.0:1789264227.451041:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c39835b2f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c39833c7800 00000020:00080000:1.0:1789264227.451050:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1789264227.451125:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789264227.451194:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789264227.451317:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39826a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+22:11375:x1876179311194112:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 Request processed in 9983us (11055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.451327:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 135 00010000:00010000:0.0:1789264227.451782:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7222 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451793:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7222 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451800:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7222 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451821:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.451827:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7222 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451835:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7222 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451851:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c3ab7e7d500) 00010000:00010000:0.0:1789264227.451853:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264227.451858:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7222 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451865:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7222 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451889:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451895:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451901:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451905:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622c00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.451908:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451913:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451931:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c39824a1f00) 00010000:00010000:0.0:1789264227.451934:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264227.451936:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72ca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451942:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622c00/0xecaf9f2f14ed72ca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451957:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d600/0xecaf9f2f14ed7348 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451963:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d600/0xecaf9f2f14ed7348 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451968:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d600/0xecaf9f2f14ed7348 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451973:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1d600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.451976:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d600/0xecaf9f2f14ed7348 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451981:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d600/0xecaf9f2f14ed7348 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451987:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3aa98f2800) 00010000:00010000:0.0:1789264227.451989:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264227.451992:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d600/0xecaf9f2f14ed7348 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.451997:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d600/0xecaf9f2f14ed7348 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452016:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed736b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452021:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed736b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452027:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed736b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452032:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1d200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.452035:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed736b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452040:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed736b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452046:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3aa98f2800) 00010000:00010000:0.0:1789264227.452048:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264227.452051:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed736b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452056:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed736b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452067:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed743d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452073:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed743d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452078:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed743d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452087:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.452090:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed743d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452096:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed743d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452114:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:0.0:1789264227.452116:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264227.452119:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed743d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452124:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed743d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452135:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452141:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452146:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452150:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366bc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.452153:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452158:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452174:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c398249f900) 00010000:00010000:0.0:1789264227.452176:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789264227.452179:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.452184:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed74fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264227.452625:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322781696:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789264227.452683:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264227.452761:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789264227.452768:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322781824:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789264227.452807:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264227.452894:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322781696 00000100:00100000:1.0:1789264227.452901:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322781696 00000100:00100000:1.0:1789264227.452946:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322781824 00000100:00100000:1.0:1789264227.452950:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322781824 00000100:00100000:1.0:1789264227.452971:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789264227.452980:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322781696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789264227.453005:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:1.0:1789264227.453027:0:8406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ed66208/0xecaf9f2f14ed7524 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.453058:0:8406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025e15a98/0xecaf9f2f14ed72d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab9b expref: 11 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.453066:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789264227.453070:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789264227.453076:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ed66208/0xecaf9f2f14ed7524 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.453115:0:8406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025e15a98/0xecaf9f2f14ed72d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab9b expref: 11 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.453129:0:8406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025e15a98/0xecaf9f2f14ed72d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab9b expref: 11 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264227.453141:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1876179322781952:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264227.453191:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c22e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789264227.453208:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789264227.453216:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322781824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789264227.453229:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1789264227.453251:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa60162, atime: 0x6aa60162, ctime: 0x6aa60162, blocks: 0x8 00010000:00010000:1.0:1789264227.453256:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed752b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.453264:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=307s v=(0 0) 00010000:00010000:1.0:1789264227.453272:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264227.453278:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed752b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.453290:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed752b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.453298:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed752b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.453304:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed752b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.453318:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789264227.453469:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3622:x1876179322781824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 254us (660us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789264227.453476:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1789264227.453712:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264227.453719:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed752b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.453728:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44a00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:0.0:1789264227.453732:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed752b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.453758:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed752b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.453775:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed752b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.453784:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed752b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.453801:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264227.453802:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264227.453811:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789264227.454169:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c39836e0380/2, rc 0, transno 4294967305 00000100:00100000:3.0:1789264227.454178:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322781824:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789264227.458995:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.459412:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311194240 00000100:00100000:0.0:1789264227.459422:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311194240 00000100:00100000:0.0:1789264227.459529:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:0.0:1789264227.459541:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+12:2402:x1876179311194240:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789264227.462654:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:3.0:1789264227.463546:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1876179322781952:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264227.463576:0:8406:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003ed66208/0xecaf9f2f14ed7524 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264227.464098:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264227.464172:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311194368 00000100:00100000:3.0:1789264227.464179:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311194368 00010000:00010000:3.0:1789264227.464213:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025e15a98/0xecaf9f2f14ed72d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab9b expref: 8 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264227.464267:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 74 00000100:00100000:3.0:1789264227.464275:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311194368:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264227.464295:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264227.464300:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025e15a98/0xecaf9f2f14ed72d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab9b expref: 8 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.464313:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025e15a98/0xecaf9f2f14ed72d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab9b expref: 8 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.464366:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025e15a98/0xecaf9f2f14ed72d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab9b expref: 8 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.464382:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789264227.464386:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789264227.464392:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ed66208/0xecaf9f2f14ed7524 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.464447:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ed66208/0xecaf9f2f14ed7524 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.464475:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789264227.464535:0:8406:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003ed66208/0xecaf9f2f14ed7524 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.464543:0:8406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ed66208/0xecaf9f2f14ed7524 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.464552:0:8406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ed66208/0xecaf9f2f14ed7524 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.464569:0:8406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ed66208/0xecaf9f2f14ed7524 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.464584:0:8406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789264227.464645:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2402:x1876179311194368:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 369us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.464652:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 74 00010000:00010000:3.0:1789264227.464676:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264227.464681:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ed66208/0xecaf9f2f14ed7524 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.464689:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45400 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264227.464693:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ed66208/0xecaf9f2f14ed7524 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.464702:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ed66208/0xecaf9f2f14ed7524 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.464714:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ed66208/0xecaf9f2f14ed7524 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.464722:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ed66208/0xecaf9f2f14ed7524 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.464782:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264227.464784:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264227.464786:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264227.465606:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311194240:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 Request processed in 6063us (6614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264227.465616:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:1.0:1789264227.466042:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322781696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13061us (13356us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789264227.466050:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:3.0:1789264227.466236:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c39836fea00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789264227.466245:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322781696:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789264227.468029:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.468069:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311194624 00000100:00100000:0.0:1789264227.468076:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311194624 00000100:00100000:0.0:1789264227.468131:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 136 00000100:00100000:0.0:1789264227.468140:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+16:11375:x1876179311194624:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789264227.468192:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264227.468216:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed750f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac35 expref: 16 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.468233:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c398249f900) 00010000:00010000:0.0:1789264227.468238:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264227.468265:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7532 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.468279:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7532 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.468288:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7532 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789264227.468521:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f44acaa reply state 00000000f7d2614d transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7532 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.468547:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7532 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.468553:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c398249f900) 00010000:00010000:0.0:1789264227.468555:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789264227.468557:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789264227.468634:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+17:11375:x1876179311194624:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 495us (612us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1789264227.468641:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 136 00000100:00100000:2.0:1789264227.471623:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264227.471896:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311194752 00000100:00100000:3.0:1789264227.471906:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311194752 00000100:00100000:3.0:1789264227.471966:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:3.0:1789264227.471976:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311194752:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789264227.472128:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789264227.472144:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789264227 00002000:00010000:3.0:1789264227.472147:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789264226 00002000:00010000:3.0:1789264227.472149:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789264227 -> 1789264227 00002000:00010000:3.0:1789264227.472152:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789264227.472216:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2402:x1876179311194752:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 240us (602us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789264227.472223:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:3.0:1789264227.475534:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.477270:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311195008 00000100:00100000:0.0:1789264227.477285:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311195008 00000100:00100000:1.0:1789264227.477637:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 137 00000100:00100000:1.0:1789264227.477647:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+17:11375:x1876179311195008:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789264227.478263:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.478416:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed74f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac27 expref: 17 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.478428:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.478469:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed74f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac27 expref: 17 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.478485:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed74f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac27 expref: 17 pid: 9197 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264227.478501:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322782080:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264227.478622:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c22600 going to sleep for 11 seconds 00000100:00100000:2.0:1789264227.482449:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322782080:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264227.482478:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264227.483365:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264227.483450:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311195136 00000100:00100000:2.0:1789264227.483458:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311195136 00010000:00010000:2.0:1789264227.483497:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed74f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac27 expref: 18 pid: 9197 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264227.483547:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 75 00000100:00100000:2.0:1789264227.483558:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+18:2403:x1876179311195136:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264227.483572:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264227.483579:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed74f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac27 expref: 18 pid: 9197 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.483593:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed74f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac27 expref: 18 pid: 9197 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.483616:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed74f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac27 expref: 18 pid: 9197 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.483650:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c398249f900) 00010000:00010000:2.0:1789264227.483655:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.483665:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.483673:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.483705:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264227.483805:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+17:2403:x1876179311195136:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 249us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264227.483813:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 75 00010000:00010000:3.0:1789264227.486125:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.486143:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.486187:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.486195:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.486202:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.486209:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45e00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264227.486213:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.486220:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.486258:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c398249f900) 00010000:00010000:3.0:1789264227.486261:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789264227.486265:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.486272:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7539 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264227.486375:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+16:11375:x1876179311195008:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 Request processed in 8725us (10846us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789264227.486385:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 137 00000100:00100000:3.0:1789264227.489604:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264227.489698:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311195264 00000100:00100000:1.0:1789264227.489708:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311195264 00000100:00100000:1.0:1789264227.489807:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:1.0:1789264227.489817:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2403:x1876179311195264:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789264227.489859:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e0764ada/0xecaf9f2f14ed7540 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.489879:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed751d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac43 expref: 7 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.489888:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264227.489892:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789264227.489897:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0764ada/0xecaf9f2f14ed7540 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.489930:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed751d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac43 expref: 7 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.489944:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed751d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac43 expref: 7 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264227.489959:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8403:1876179322782208:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264227.490042:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c22f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789264227.493947:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8403:1876179322782208:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264227.493977:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0764ada/0xecaf9f2f14ed7540 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264227.495044:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264227.495341:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311195392 00000100:00100000:2.0:1789264227.495350:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311195392 00010000:00010000:2.0:1789264227.495389:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed751d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac43 expref: 8 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264227.495430:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 76 00000100:00100000:2.0:1789264227.495440:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311195392:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264227.495455:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264227.495490:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed751d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac43 expref: 8 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.495503:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed751d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac43 expref: 8 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.495535:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed751d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac43 expref: 8 pid: 10317 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.495552:0:7892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789264227.495557:0:7892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789264227.495562:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0764ada/0xecaf9f2f14ed7540 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.495571:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0764ada/0xecaf9f2f14ed7540 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.495608:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264227.495663:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2402:x1876179311195392:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 224us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264227.495672:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 76 00010000:00010000:3.0:1789264227.496031:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0764ada/0xecaf9f2f14ed7540 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.496041:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0764ada/0xecaf9f2f14ed7540 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.496064:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e0764ada/0xecaf9f2f14ed7540 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.496072:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0764ada/0xecaf9f2f14ed7540 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.496080:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0764ada/0xecaf9f2f14ed7540 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.496118:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44800 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264227.496122:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0764ada/0xecaf9f2f14ed7540 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.496132:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0764ada/0xecaf9f2f14ed7540 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.496146:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0764ada/0xecaf9f2f14ed7540 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.496154:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0764ada/0xecaf9f2f14ed7540 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264227.496216:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2403:x1876179311195264:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 Request processed in 6400us (6622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.496224:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:3.0:1789264227.499827:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.499942:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311195648 00000100:00100000:0.0:1789264227.499952:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311195648 00000100:00100000:0.0:1789264227.500010:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 138 00000100:00100000:0.0:1789264227.500020:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+16:11375:x1876179311195648:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789264227.500094:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.500121:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7436 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabef expref: 16 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.500131:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.500165:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7436 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabef expref: 16 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.500179:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7436 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabef expref: 16 pid: 9197 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264227.500205:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaceea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322782336:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264227.500323:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789264227.504116:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264227.504187:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311195776 00000100:00100000:1.0:1789264227.504196:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311195776 00010000:00010000:1.0:1789264227.504242:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7436 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabef expref: 17 pid: 9197 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264227.504278:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 77 00000100:00100000:1.0:1789264227.504294:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+17:2403:x1876179311195776:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264227.504307:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264227.504314:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7436 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabef expref: 17 pid: 9197 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.504327:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7436 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabef expref: 17 pid: 9197 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.504348:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:1.0:1789264227.504355:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7498 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac12 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.504365:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.504372:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.504378:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.504393:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264227.504445:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+17:2403:x1876179311195776:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 152us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264227.504452:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 77 00010000:00010000:3.0:1789264227.505777:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7436 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdabef expref: 16 pid: 9197 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264227.505801:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaceea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322782336:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264227.505822:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.505873:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.505881:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.506041:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.506062:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7501 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac2e expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.506070:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.506115:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7501 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac2e expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.506129:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7501 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac2e expref: 16 pid: 6492 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264227.506141:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322782464:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264227.506213:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1789264227.509534:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264227.509632:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311195904 00000100:00100000:1.0:1789264227.509641:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311195904 00010000:00010000:1.0:1789264227.509681:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7501 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac2e expref: 17 pid: 6492 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264227.509842:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 78 00000100:00100000:3.0:1789264227.509868:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaced180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+17:2402:x1876179311195904:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264227.509884:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264227.509891:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7501 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac2e expref: 17 pid: 6492 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.509903:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7501 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac2e expref: 17 pid: 6492 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.509926:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c398249f900) 00010000:00010000:3.0:1789264227.509932:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.509941:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.509948:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264227.509966:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264227.510023:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaced180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+17:2402:x1876179311195904:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 157us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.510031:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 78 00010000:00010000:2.0:1789264227.511606:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7501 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac2e expref: 16 pid: 6492 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264227.511629:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322782464:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264227.511653:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.511662:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.511668:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789264227.511832:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1789264227.511974:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1789264227.512008:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1789264227.512084:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1876179322782592:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789264227.512329:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264227.512360:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789264227.512597:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322782592 00000100:00100000:3.0:1789264227.512604:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322782592 00000100:00100000:3.0:1789264227.512665:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789264227.512674:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6491:x1876179322782592:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789264227.512787:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6491:x1876179322782592:12345-0@lo:1000:mdt00_001.0 Request processed in 113us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.512795:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789264227.512940:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1876179322782592:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789264227.513068:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1789264227.513141:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abacece00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1876179322782720:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789264227.513174:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264227.513200:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264227.513417:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322782720 00000100:00100000:3.0:1789264227.513422:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322782720 00000100:00100000:3.0:1789264227.513446:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789264227.513453:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6491:x1876179322782720:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789264227.513575:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6491:x1876179322782720:12345-0@lo:1000:mdt00_001.0 Request processed in 122us (400us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789264227.513581:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789264227.513704:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abacece00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1876179322782720:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789264227.513767:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513775:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513782:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513787:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.513791:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513798:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513812:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c398249f900) 00010000:00010000:0.0:1789264227.513824:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789264227.513828:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513833:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed754e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513854:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7491 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513859:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7491 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513864:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7491 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513867:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36aa00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264227.513870:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7491 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513874:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7491 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513880:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:0.0:1789264227.513882:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789264227.513888:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7498 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac12 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513899:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7498 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac12 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513906:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7498 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac12 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264227.513937:0:6491:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7498 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac12 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264227.513947:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abacec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322782848:192.168.203.44@tcp:105: 00000100:00100000:0.0:1789264227.514012:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8f254f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789264227.516931:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abacec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322782848:192.168.203.44@tcp:105: 00010000:00010000:2.0:1789264227.516962:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7491 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.516972:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7491 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517004:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed7555 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517017:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed7555 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517028:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed7555 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517037:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed7555 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517044:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed7555 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517050:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed7555 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517056:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1ce00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264227.517060:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed7555 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517082:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed7555 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517094:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:2.0:1789264227.517097:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264227.517112:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed7555 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517119:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed7555 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517130:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517136:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517142:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517146:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264227.517149:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517154:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517162:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:2.0:1789264227.517164:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789264227.517167:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.517183:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7547 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264227.517360:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+19:11375:x1876179311195648:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 17340us (17540us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789264227.517371:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 138 00000020:00080000:2.0:1789264227.517377:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789264227.517584:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789264227.517590:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789264227.518141:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789264227.518152:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789264227.522619:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264227.522713:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311196032 00000100:00100000:1.0:1789264227.522733:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311196032 00000100:00100000:1.0:1789264227.522814:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:1.0:1789264227.522824:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+19:11374:x1876179311196032:12345-192.168.203.44@tcp:49:lfs.0 00000100:00100000:1.0:1789264227.522949:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+19:11374:x1876179311196032:12345-192.168.203.44@tcp:49:lfs.0 Request processed in 125us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264227.522957:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:0.0:1789264227.525164:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264227.525251:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311196288 00000100:00100000:1.0:1789264227.525260:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311196288 00000100:00100000:1.0:1789264227.525320:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 32 00000100:00100000:1.0:1789264227.525330:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab27a6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+19:11375:x1876179311196288:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789264227.525585:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789264227.525614:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1789264227.525645:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed755c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.525662:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed755c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.525672:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed755c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.525680:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed755c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.525703:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed755c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.525710:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed755c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.525735:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789264227.525852:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab27a6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+21:11375:x1876179311196288:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 522us (694us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789264227.525859:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 32 00000020:00080000:1.0:1789264227.525863:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789264227.526012:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264227.526019:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed755c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.526027:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44c00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264227.526030:0:7431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed755c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.526037:0:7431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed755c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.526050:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c398249f900) 00010000:00010000:2.0:1789264227.526053:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789264227.526057:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed755c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.526063:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed755c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.526076:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264227.526078:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264227.526080:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264227.529191:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264227.529287:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311196544 00000100:00100000:0.0:1789264227.529297:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311196544 00000100:00100000:0.0:1789264227.529355:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 139 00000100:00100000:0.0:1789264227.529366:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+21:11374:x1876179311196544:12345-192.168.203.44@tcp:58:lfs.0 00000040:00080000:0.0:1789264227.529551:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789264227.529637:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+21:11374:x1876179311196544:12345-192.168.203.44@tcp:58:lfs.0 Request processed in 272us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264227.529646:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 139 00000100:00100000:3.0:1789264227.555944:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264227.556042:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311196672 00000100:00100000:2.0:1789264227.556052:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311196672 00000100:00100000:2.0:1789264227.556130:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 140 00000100:00100000:2.0:1789264227.556141:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+21:11377:x1876179311196672:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264227.556164:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264227.556184:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed7563 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac4a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.556246:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed756a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.556259:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed756a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.556271:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed756a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.556287:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7571 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.556294:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.556300:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.556425:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7578 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.556436:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac0b expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.556463:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7578 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.556497:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac0b expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.556524:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac0b expref: 22 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264227.556537:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322782976:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264227.556640:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789264227.562480:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322782976:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264227.562519:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7578 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264227.564432:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264227.564694:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311196928 00000100:00100000:1.0:1789264227.564703:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311196928 00000100:00100000:1.0:1789264227.564790:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:1.0:1789264227.564800:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+23:6164:x1876179311196928:12345-192.168.203.44@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789264227.565001:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+24:6164:x1876179311196928:12345-192.168.203.44@tcp:35:ldlm_bl.0 Request processed in 201us (577us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789264227.565008:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:3.0:1789264227.567207:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264227.567444:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311197056 00000100:00100000:1.0:1789264227.567452:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311197056 00010000:00010000:1.0:1789264227.567488:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac0b expref: 24 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264227.567543:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 79 00000100:00100000:1.0:1789264227.567553:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983724a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+24:2402:x1876179311197056:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264227.567569:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264227.567588:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac0b expref: 24 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.567601:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac0b expref: 24 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.567625:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7483 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac0b expref: 24 pid: 6491 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.567640:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:1.0:1789264227.567645:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7578 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.567654:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7578 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.567661:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7578 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264227.567690:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264227.567785:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983724a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+23:2402:x1876179311197056:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 234us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264227.567792:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 79 00010000:00010000:2.0:1789264227.568263:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7578 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568273:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7578 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264227.568335:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789264227.568339:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264227.568361:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7578 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568374:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7578 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568395:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed756a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568400:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed756a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568406:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed756a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568411:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1d000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264227.568415:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed756a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568422:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed756a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568431:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:2.0:1789264227.568434:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264227.568438:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed756a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568444:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed756a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568455:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568461:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7571 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568467:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7571 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568478:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1dc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264227.568482:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7571 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568488:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7571 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568497:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c3aa98f2c00) 00010000:00010000:2.0:1789264227.568499:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264227.568502:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7571 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568516:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7571 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568552:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed7563 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac4a expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568565:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7578 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac4a expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264227.568573:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:2.0:1789264227.568575:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789264227.568578:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1ca00, rc 0) 00000100:00100000:2.0:1789264227.568624:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+22:11377:x1876179311196672:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 12485us (12688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264227.568632:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 140 00000100:00100000:0.0:1789264227.850021:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322783104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789264227.850106:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264227.850272:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322783104 00000100:00100000:3.0:1789264227.850287:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322783104 00000100:00100000:3.0:1789264227.850343:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789264227.850353:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322783104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789264227.850383:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789264227.850430:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322783104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264227.850437:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789264227.850643:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322783104:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789264227.978030:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789264228.239050:0:14271:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789264228.239058:0:14271:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789264228.239087:0:14271:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789264228.239092:0:14271:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789264228.304437:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264228.304492:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264228.304537:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264228.304564:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264228.304584:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264228.304602:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264228.304626:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264228.304664:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311197568 00000100:00100000:0.0:1789264228.304674:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311197568 00000100:00100000:0.0:1789264228.304725:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311197696 00000100:00100000:0.0:1789264228.304729:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311197696 00000100:00100000:0.0:1789264228.304780:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 88 00000100:00100000:0.0:1789264228.304790:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311197568:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264228.304860:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311197568:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 72us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264228.304868:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 88 00000100:00100000:0.0:1789264228.304886:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89 00000100:00100000:0.0:1789264228.304893:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2403:x1876179311197696:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264228.304919:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2403:x1876179311197696:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264228.304925:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89 00000100:00100000:0.0:1789264228.304943:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311197312 00000100:00100000:0.0:1789264228.304946:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311197312 00000100:00100000:0.0:1789264228.304970:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311197440 00000100:00100000:0.0:1789264228.304973:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311197440 00000100:00100000:0.0:1789264228.304985:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311197824 00000100:00100000:0.0:1789264228.304988:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311197824 00000100:00100000:0.0:1789264228.305000:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311197952 00000100:00100000:0.0:1789264228.305003:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311197952 00000100:00100000:0.0:1789264228.305017:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 213 00000100:00100000:0.0:1789264228.305024:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+22:2402:x1876179311197312:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264228.305057:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+22:2402:x1876179311197312:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 33us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264228.305063:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 213 00000100:00100000:0.0:1789264228.305083:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 214 00000100:00100000:0.0:1789264228.305088:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2403:x1876179311197440:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264228.305115:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2403:x1876179311197440:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264228.305121:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 214 00000100:00100000:0.0:1789264228.305133:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 215 00000100:00100000:0.0:1789264228.305140:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311197824:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264228.305165:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311197824:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264228.305172:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 215 00000100:00100000:0.0:1789264228.305186:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 216 00000100:00100000:0.0:1789264228.305194:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2403:x1876179311197952:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264228.305216:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2403:x1876179311197952:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264228.305222:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 216 00000100:00100000:3.0:1789264228.305225:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311197184 00000100:00100000:3.0:1789264228.305229:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311197184 00000100:00100000:3.0:1789264228.305261:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363 00000100:00100000:3.0:1789264228.305268:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2403:x1876179311197184:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264228.305371:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2403:x1876179311197184:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 103us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264228.305384:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363 00000100:00080000:3.0:1789264228.305414:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789264228.305418:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789264228.305420:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789264228.305423:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789264228.553958:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789264228.553968:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789264228.553994:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789264228.554002:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789264228.554141:0:13760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13760:1876179322783232:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789264228.554321:0:13760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264228.561037:0:13760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13760:1876179322783232:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789264228.561423:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264228.562577:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311198080 00000100:00100000:2.0:1789264228.562599:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311198080 00000100:00100000:2.0:1789264228.562653:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 141 00000100:00100000:2.0:1789264228.562663:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+22:11389:x1876179311198080:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789264228.562693:0:6490:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789264228.562845:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+22:11389:x1876179311198080:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 182us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264228.562853:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 141 00000100:00100000:1.0:1789264228.581639:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264228.581914:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311198336 00000100:00100000:2.0:1789264228.581926:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311198336 00000100:00100000:2.0:1789264228.582003:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 142 00000100:00100000:2.0:1789264228.582013:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+22:11389:x1876179311198336:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789264228.582032:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264228.582054:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed757f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac51 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264228.582159:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7586 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264228.582172:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264228.582184:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264228.582195:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789264228.582289:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed757f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac51 expref: 25 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264228.582302:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7586 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac51 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264228.582319:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:2.0:1789264228.582321:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789264228.582324:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c600, rc 0) 00000100:00100000:2.0:1789264228.582369:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+24:11389:x1876179311198336:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 360us (739us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789264228.582374:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 142 00000100:00100000:3.0:1789264228.586732:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264228.586979:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264228.587100:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311198720 00000100:00100000:0.0:1789264228.587115:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311198720 00000100:00100000:0.0:1789264228.587242:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:0.0:1789264228.587256:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+24:2405:x1876179311198720:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264228.587279:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264228.587312:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7586 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac51 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264228.587359:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:0.0:1789264228.587364:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264228.587547:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+23:2405:x1876179311198720:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 293us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264228.587554:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:2.0:1789264228.589470:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311198592 00000100:00100000:2.0:1789264228.590594:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311198592 00000100:00100000:2.0:1789264228.590668:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 143 00000100:00100000:2.0:1789264228.590678:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+23:11389:x1876179311198592:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789264228.590787:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed7594 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264228.590803:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed7594 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264228.590814:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed7594 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264228.590955:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed7594 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264228.590963:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed7594 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264228.590970:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed7594 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264228.590996:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264228.591000:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed7594 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264228.591009:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed7594 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264228.591022:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:2.0:1789264228.591026:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789264228.591031:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed7594 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264228.591038:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed7594 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264228.591189:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+24:11389:x1876179311198592:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 510us (4536us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789264228.591199:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 143 00000040:00080000:3.0:1789264228.591319:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789264228.591329:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789264228.591903:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789264228.591915:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789264228.594022:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264228.594306:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311198976 00000100:00100000:1.0:1789264228.594320:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311198976 00000100:00100000:1.0:1789264228.594402:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:1.0:1789264228.594413:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+24:11389:x1876179311198976:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789264228.594708:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+25:11389:x1876179311198976:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 295us (699us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789264228.594716:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 34 00010000:00010000:3.0:1789264229.004558:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264229.898913:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322783360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789264229.898985:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264229.899060:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322783360 00000100:00100000:2.0:1789264229.899066:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322783360 00000100:00100000:2.0:1789264229.899127:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789264229.899136:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322783360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789264229.899164:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264229.899200:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322783360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264229.899207:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1789264229.899234:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789264229.899277:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322783360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789264229.899732:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789264229.899759:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322783488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789264229.899796:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264229.899825:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322783488 00000100:00100000:3.0:1789264229.899830:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322783488 00000100:00100000:3.0:1789264229.899860:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789264229.899867:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1876179322783488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789264229.899886:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264229.899920:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1876179322783488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264229.899926:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789264229.899958:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322783488:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789264229.901415:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789264229.983997:0:14322:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789264229.984007:0:14322:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789264229.984070:0:14322:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789264229.984076:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789264230.026901:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264230.163143:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264230.163268:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311199232 00000100:00100000:1.0:1789264230.163278:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311199232 00000100:00100000:1.0:1789264230.163401:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 144 00000100:00100000:1.0:1789264230.163413:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+25:11409:x1876179311199232:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1789264230.163437:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264230.163462:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed759b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac58 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264230.163587:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed75a2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264230.163602:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed75a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264230.163613:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed75a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264230.163624:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789264230.163739:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed759b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac58 expref: 28 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264230.163804:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed75a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac58 expref: 27 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264230.163827:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:1.0:1789264230.163830:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789264230.163834:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45400, rc 0) 00000100:00100000:1.0:1789264230.163886:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+27:11409:x1876179311199232:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 476us (752us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789264230.163893:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 144 00000100:00080000:2.0:1789264230.165140:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264230.178028:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264230.181682:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311199360 00000100:00100000:0.0:1789264230.181698:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311199360 00000100:00100000:0.0:1789264230.182249:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 145 00000100:00100000:0.0:1789264230.182258:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+27:11409:x1876179311199360:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:0.0:1789264230.182326:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264230.182344:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264230.182357:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264230.182391:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264230.182397:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264230.182417:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264230.182421:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ae00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264230.182424:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264230.182429:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264230.182438:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:0.0:1789264230.182440:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789264230.182443:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264230.182447:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264230.182534:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+27:11409:x1876179311199360:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 276us (4584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264230.182541:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 145 00000100:00100000:3.0:1789264230.279787:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264230.279895:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311199488 00000100:00100000:2.0:1789264230.279906:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311199488 00000100:00100000:2.0:1789264230.279980:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:2.0:1789264230.279992:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311199488:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:2.0:1789264230.280010:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264230.280031:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099ae7558/0xecaf9f2f14ed75b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac5f expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789264230.280056:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa60163, atime: 0x6aa60162, ctime: 0x6aa60163, blocks: 0x8 00010000:00010000:2.0:1789264230.280077:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=310s v=(0 0) 00010000:00010000:2.0:1789264230.280081:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264230.280091:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099ae7558/0xecaf9f2f14ed75b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac5f expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264230.280110:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099ae7558/0xecaf9f2f14ed75b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac5f expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264230.280125:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1d600, rc 0) 00000100:00100000:2.0:1789264230.280184:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2402:x1876179311199488:12345-192.168.203.44@tcp:101:cat.0 Request processed in 194us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264230.280191:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00080000:0.0:1789264230.283820:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789264230.287815:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264230.287922:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311199616 00000100:00100000:0.0:1789264230.287933:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311199616 00002000:00100000:0.0:1789264230.287982:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9c3983cd3480 x1876179311199616/t0(0) o3->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:311/0 lens 488/0 e 0 to 0 dl 1789264241 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789264230.287992:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3983cd3480 with x1876179311199616 ext(0->4095) 00002000:00010000:0.0:1789264230.287997:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c3983cd3480 00000100:00100000:0.0:1789264230.288030:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:0.0:1789264230.288046:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2403:x1876179311199616:12345-192.168.203.44@tcp:3:cat.0 00000100:00100000:0.0:1789264230.288221:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2403:x1876179311199616:12345-192.168.203.44@tcp:3:cat.0 Request processed in 175us (414us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789264230.288229:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 4 00002000:00100000:0.0:1789264230.288236:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9c3983cd3480 x1876179311199616/t0(0) o3->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:311/0 lens 488/4536 e 0 to 0 dl 1789264241 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789264230.288244:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3983cd3480 with x1876179311199616 ext(0->4095) 00002000:00010000:0.0:1789264230.288247:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c3983cd3480 00000100:00100000:3.0:1789264230.409922:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789264230.409945:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322783616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789264230.410050:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264230.413015:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322783616 00000100:00100000:1.0:1789264230.413030:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322783616 00000100:00100000:1.0:1789264230.413171:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789264230.413182:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322783616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789264230.413219:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789264230.413308:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322783616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (3258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264230.413315:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789264230.413405:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322783616:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789264231.050038:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264232.077875:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264232.459518:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322783872:0@lo:400:kworker.0 00000100:00100000:0.0:1789264232.459596:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264232.459614:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322783744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264232.459688:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264232.459723:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322783744 00000100:00100000:0.0:1789264232.459737:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322783744 00000100:00100000:0.0:1789264232.459860:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789264232.459870:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322783744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789264232.459897:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789264232.459987:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789264232.460010:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322784000:0@lo:400:kworker.0 00000004:00080000:1.0:1789264232.460058:0:10066:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 312801311948ns, next at 313801305991ns, rc = 0 00000100:00100000:1.0:1789264232.460095:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322783872 00000100:00100000:1.0:1789264232.460100:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322783872 00000100:00100000:1.0:1789264232.460138:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789264232.460147:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3625:x1876179322783872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264232.460293:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322783744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 424us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264232.460301:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1789264232.460324:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789264232.462926:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322783744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264232.462997:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789264232.463013:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322784128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789264232.463083:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264232.463389:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322784128 00000100:00100000:3.0:1789264232.463398:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322784128 00000100:00100000:3.0:1789264232.463469:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789264232.463490:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1876179322784128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789264232.463519:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789264232.463597:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1876179322784128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264232.463629:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1789264232.463671:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789264232.463714:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322784128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789264232.463968:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789264232.463979:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abaa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322784256:0@lo:400:kworker.0 00000100:00100000:3.0:1789264232.464016:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264232.464047:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322784256 00000100:00100000:3.0:1789264232.464051:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322784256 00000100:00100000:3.0:1789264232.464097:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789264232.464104:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322784256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264232.464144:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322784256:12345-0@lo:400:kworker.0 Request processed in 40us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264232.464150:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789264232.464173:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abaa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322784256:0@lo:400:kworker.0 00000100:00100000:3.0:1789264232.464216:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322784384:0@lo:400:kworker.0 00000100:00100000:2.0:1789264232.464431:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264232.464498:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3625:x1876179322783872:12345-0@lo:400:kworker.0 Request processed in 4346us (4896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264232.464499:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322784512:0@lo:400:kworker.0 00000100:00100000:1.0:1789264232.464521:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789264232.464526:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322784000 00000100:00100000:2.0:1789264232.464536:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322784000 00000100:00100000:3.0:1789264232.464553:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264232.464598:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789264232.464608:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322784000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264232.464616:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264232.464669:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322784000:12345-0@lo:400:kworker.0 Request processed in 62us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264232.464675:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789264232.464728:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322784512 00000100:00100000:3.0:1789264232.464735:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322784512 00000100:00100000:3.0:1789264232.464807:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789264232.464814:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322784512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264232.464864:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322784512:12345-0@lo:400:kworker.0 Request processed in 49us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264232.464870:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789264232.464911:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322784512:0@lo:400:kworker.0 00000100:00100000:3.0:1789264232.464942:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789264232.464951:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322784640:0@lo:400:kworker.0 00000100:00100000:3.0:1789264232.465037:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322784768:0@lo:400:kworker.0 00000100:00100000:3.0:1789264232.465126:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322785152:0@lo:400:kworker.0 00000100:00100000:2.0:1789264232.465661:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322784384 00000100:00100000:2.0:1789264232.465671:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322784384 00000100:00100000:2.0:1789264232.466385:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789264232.466400:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322784384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264232.466469:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322784384:12345-0@lo:400:kworker.0 Request processed in 74us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264232.466491:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322784384:0@lo:400:kworker.0 00000100:00100000:1.0:1789264232.466528:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322783872:0@lo:400:kworker.0 00000100:00100000:1.0:1789264232.466560:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322784896:0@lo:400:kworker.0 00000100:00100000:2.0:1789264232.466643:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789264232.466852:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264232.466889:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322785280:0@lo:400:kworker.0 00000100:00100000:2.0:1789264232.466915:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264232.466973:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322784768 00000100:00100000:2.0:1789264232.466978:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322784768 00000100:00100000:2.0:1789264232.467015:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322785280 00000100:00100000:2.0:1789264232.467018:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322785280 00000100:00100000:2.0:1789264232.467038:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789264232.467044:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322784768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264232.467082:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322784768:12345-0@lo:400:kworker.0 Request processed in 37us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264232.467095:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789264232.467108:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789264232.467114:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322785280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264232.467142:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322785280:12345-0@lo:400:kworker.0 Request processed in 28us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264232.467147:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:2.0:1789264232.467165:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789264232.467189:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983f49180 x1876179322785280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264232.467201:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322785280:0@lo:400:kworker.0 00010000:00080000:2.0:1789264232.467212:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983f49500 x1876179322784768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264232.467222:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322784768:0@lo:400:kworker.0 00000100:00100000:1.0:1789264232.467230:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264232.467288:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264232.467296:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322784896 00000100:00100000:1.0:1789264232.467301:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322784896 00000100:00100000:1.0:1789264232.467355:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789264232.467364:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322784896:12345-0@lo:400:kworker.0 00000001:00080000:0.0:1789264232.467393:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1789264232.467414:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322784896:12345-0@lo:400:kworker.0 Request processed in 49us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264232.467423:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789264232.467455:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322785024:0@lo:400:kworker.0 00000100:00100000:1.0:1789264232.467457:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322784896:0@lo:400:kworker.0 00000100:00100000:2.0:1789264232.467502:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264232.467539:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322785024 00000100:00100000:2.0:1789264232.467543:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322785024 00000100:00100000:2.0:1789264232.467574:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789264232.467582:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322785024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264232.467613:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322784640 00000100:00100000:1.0:1789264232.467620:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322784640 00000100:00100000:2.0:1789264232.467625:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322785024:12345-0@lo:400:kworker.0 Request processed in 39us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264232.467633:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1789264232.467667:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264232.467671:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00080000:2.0:1789264232.467679:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264232.467681:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322784640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264232.467702:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000100:00100000:1.0:1789264232.467719:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322784640:12345-0@lo:400:kworker.0 Request processed in 41us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264232.467725:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000004:00080000:2.0:1789264232.467805:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1789264232.467819:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c39836e0380, transno 4294967305 00000100:00100000:2.0:1789264232.467838:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322785024:0@lo:400:kworker.0 00000100:00100000:2.0:1789264232.467855:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322784640:0@lo:400:kworker.0 00000100:00100000:3.0:1789264232.468168:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264232.468212:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322784000:0@lo:400:kworker.0 00000100:00100000:2.0:1789264232.468581:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322785152 00000100:00100000:2.0:1789264232.468587:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322785152 00000100:00100000:2.0:1789264232.468687:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789264232.468695:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322785152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264232.468776:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322785152:12345-0@lo:400:kworker.0 Request processed in 82us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264232.468783:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789264232.468842:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322785152:0@lo:400:kworker.0 00000100:00080000:3.0:1789264232.469669:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789264232.472383:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1789264232.472482:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1789264232.472528:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c3983c52540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789264232.472533:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c3a8817df00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c3983c52840 00000020:00080000:1.0:1789264232.472536:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c3a8817de00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c3983ca9000 00000020:00080000:1.0:1789264232.472551:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1789264232.472573:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789264232.472646:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1789264232.474037:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322785408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789264232.474104:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264232.474728:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322785408 00000100:00100000:2.0:1789264232.474736:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322785408 00000100:00100000:2.0:1789264232.474804:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789264232.474812:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3625:x1876179322785408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789264232.475163:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789264232.475167:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789264227 -> 1789264227 00002000:00010000:2.0:1789264232.475170:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1789264226 -> 1789264226 00002000:00010000:2.0:1789264232.475172:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789264227 -> 1789264227 00002000:00010000:2.0:1789264232.475174:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789264232.475223:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3625:x1876179322785408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 411us (1118us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789264232.475229:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1789264232.475513:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c3ab301ed80/2, rc 0, transno 4294967314 00000100:00100000:1.0:1789264232.475520:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322785408:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1789264232.476927:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:1.0:1789264232.476949:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:3.0:1789264232.478079:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7532 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264232.478098:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7532 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264232.478106:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7532 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264232.478113:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366bc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264232.478118:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7532 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264232.478126:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7532 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264232.478142:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c398249f900) 00010000:00010000:3.0:1789264232.478144:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264232.478148:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7532 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264232.478174:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7532 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264232.972042:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322785536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789264232.972112:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264232.975164:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322785536 00000100:00100000:3.0:1789264232.975178:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322785536 00000100:00100000:3.0:1789264232.975432:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789264232.975443:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322785536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789264232.975488:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789264232.977565:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322785536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2116us (5443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264232.977578:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789264232.986674:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322785536:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789264233.099713:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264233.421330:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264233.421371:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264233.421403:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264233.421443:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264233.421443:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311200128 00000100:00100000:1.0:1789264233.421454:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311200128 00000100:00100000:3.0:1789264233.421465:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264233.421542:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 92 00000100:00100000:1.0:1789264233.421553:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311200128:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264233.421632:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311200128:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 81us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264233.421638:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 92 00000100:00100000:2.0:1789264233.423895:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311199872 00000100:00100000:2.0:1789264233.423910:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311199872 00000100:00100000:2.0:1789264233.424018:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311200384 00000100:00100000:2.0:1789264233.424022:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311200384 00000100:00100000:1.0:1789264233.425702:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 223 00000100:00100000:1.0:1789264233.425723:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+13:2405:x1876179311199872:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264233.425826:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+13:2405:x1876179311199872:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 113us (4506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264233.425833:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 223 00000100:00100000:1.0:1789264233.425873:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 224 00000100:00100000:1.0:1789264233.425880:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311200384:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264233.425962:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311200384:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 81us (4557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264233.425968:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 224 00000100:00100000:0.0:1789264233.426958:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311200000 00000100:00100000:0.0:1789264233.426967:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311200000 00000100:00100000:3.0:1789264233.427052:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264233.427106:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 225 00000100:00100000:3.0:1789264233.427111:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264233.427116:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311200000:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264233.427151:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311200000:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 39us (5686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264233.427156:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 225 00000100:00100000:0.0:1789264233.427166:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311200512 00000100:00100000:0.0:1789264233.427168:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311200512 00000100:00100000:0.0:1789264233.427179:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 226 00000100:00100000:0.0:1789264233.427183:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311200512:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264233.427225:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311200512:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 41us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264233.427229:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311199744 00000100:00100000:0.0:1789264233.427231:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 226 00000100:00100000:3.0:1789264233.427235:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311199744 00000100:00100000:3.0:1789264233.427366:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 365 00000100:00100000:3.0:1789264233.427375:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2405:x1876179311199744:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264233.427403:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2405:x1876179311199744:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 31us (5960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264233.427411:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 365 00000100:00080000:3.0:1789264233.427444:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789264233.427448:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789264233.427451:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789264233.427598:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311200256 00000100:00100000:3.0:1789264233.427603:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311200256 00000100:00080000:0.0:1789264233.427658:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789264233.427664:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 93 00000100:00100000:3.0:1789264233.427674:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2405:x1876179311200256:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264233.427717:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2405:x1876179311200256:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 45us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264233.427724:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 93 00010000:00010000:3.0:1789264234.129144:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264234.758939:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264234.759054:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311200640 00000100:00100000:0.0:1789264234.759065:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311200640 00000100:00100000:0.0:1789264234.759124:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 146 00000100:00100000:0.0:1789264234.759133:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+13:11055:x1876179311200640:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789264234.759239:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+13:11055:x1876179311200640:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 Request processed in 106us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264234.759246:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 146 00000100:00100000:0.0:1789264234.762765:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264234.762852:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311200768 00000100:00100000:1.0:1789264234.762862:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311200768 00000100:00100000:1.0:1789264234.762920:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 147 00000100:00100000:1.0:1789264234.762930:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:11055:x1876179311200768:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789264234.763033:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+5:11055:x1876179311200768:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 Request processed in 104us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264234.763040:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 147 00000100:00100000:2.0:1789264234.765438:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264234.765586:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311201024 00000100:00100000:1.0:1789264234.765595:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311201024 00000100:00100000:1.0:1789264234.765649:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:1.0:1789264234.765659:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+13:11055:x1876179311201024:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789264234.765907:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+14:11055:x1876179311201024:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 249us (476us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789264234.765915:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:3.0:1789264234.948923:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264234.949030:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311201152 00000100:00100000:2.0:1789264234.949041:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311201152 00000100:00100000:2.0:1789264234.949109:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 148 00000100:00100000:2.0:1789264234.949119:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:11867:x1876179311201152:12345-192.168.203.44@tcp:101:lsof.0 00010000:00010000:2.0:1789264234.949139:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264234.949161:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d400/0xecaf9f2f14ed75be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac66 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264234.949356:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed75c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264234.949371:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed75c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264234.949386:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed75c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264234.949435:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789264234.949440:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264234.949490:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed75c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264234.949517:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d400/0xecaf9f2f14ed75be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac66 expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264234.949535:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed75c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac66 expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264234.949559:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c39824a1a00) 00010000:00010000:2.0:1789264234.949562:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789264234.949578:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c400, rc 0) 00000100:00100000:2.0:1789264234.949641:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:11867:x1876179311201152:12345-192.168.203.44@tcp:101:lsof.0 Request processed in 524us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264234.949648:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 148 00000100:00100000:0.0:1789264235.018124:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789264235.018148:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322785664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789264235.018217:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264235.018455:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322785664 00000100:00100000:2.0:1789264235.018481:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322785664 00000100:00100000:2.0:1789264235.018544:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789264235.018556:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322785664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789264235.018584:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264235.018627:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322785664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264235.018635:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1789264235.019001:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264235.019039:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322785664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789264235.019102:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789264235.019113:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322785792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789264235.019145:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264235.019240:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322785792 00000100:00100000:2.0:1789264235.019245:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322785792 00000100:00100000:2.0:1789264235.019292:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789264235.019300:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322785792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789264235.019313:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264235.019356:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322785792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264235.019364:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789264235.019390:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322785792:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789264235.019763:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789264235.146135:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789264235.210885:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789264235.530116:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322785920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789264235.530188:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264235.530370:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322785920 00000100:00100000:3.0:1789264235.530378:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322785920 00000100:00100000:3.0:1789264235.530445:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789264235.530466:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322785920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789264235.530496:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789264235.530649:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322785920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 194us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264235.530657:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789264235.531340:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322785920:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789264235.785937:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789264235.785946:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789264235.786027:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789264235.786034:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789264236.170285:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264237.195722:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264237.578145:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322786048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264237.578217:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264237.578279:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322786048 00000100:00100000:3.0:1789264237.578291:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322786048 00000100:00100000:3.0:1789264237.578339:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789264237.578353:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322786048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789264237.578377:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789264237.578415:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322786048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264237.578421:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1789264237.578438:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789264237.578482:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322786048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264237.578597:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322786304:0@lo:400:kworker.0 00000100:00100000:3.0:1789264237.578641:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264237.578660:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322786816:0@lo:400:kworker.0 00000100:00100000:3.0:1789264237.578679:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264237.578695:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1876179322787328:0@lo:400:kworker.0 00000100:00100000:3.0:1789264237.578712:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264237.578732:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789264237.578736:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322786432:0@lo:400:kworker.0 00000100:00100000:3.0:1789264237.578795:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264237.578811:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322786944:0@lo:400:kworker.0 00000100:00100000:3.0:1789264237.578829:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264237.578842:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322787456:0@lo:400:kworker.0 00000100:00100000:3.0:1789264237.578858:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264237.578880:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322786304 00000100:00100000:3.0:1789264237.578883:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322786304 00000100:00100000:3.0:1789264237.578903:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322786816 00000100:00100000:3.0:1789264237.578905:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322786816 00000100:00100000:2.0:1789264237.579557:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322787328 00000100:00100000:2.0:1789264237.579563:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322787328 00000100:00100000:2.0:1789264237.579592:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322786944 00000100:00100000:2.0:1789264237.579595:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322786944 00000100:00100000:2.0:1789264237.579618:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322787456 00000100:00100000:2.0:1789264237.579622:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322787456 00000100:00100000:2.0:1789264237.579638:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789264237.579645:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322786304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.579702:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322786304:12345-0@lo:400:kworker.0 Request processed in 58us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264237.579708:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789264237.579721:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789264237.579727:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1876179322787328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.579776:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1876179322787328:12345-0@lo:400:kworker.0 Request processed in 49us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264237.579781:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789264237.579795:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789264237.579800:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322786944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.579842:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322786944:12345-0@lo:400:kworker.0 Request processed in 42us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264237.579847:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789264237.579858:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789264237.579864:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322787456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.579888:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322787456:12345-0@lo:400:kworker.0 Request processed in 24us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264237.579893:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789264237.580894:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789264237.580918:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876179322786816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264237.580970:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876179322786816:12345-0@lo:400:kworker.0 Request processed in 69us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264237.580977:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:1.0:1789264237.584888:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789264237.584898:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789264237.584949:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983f49500 x1876179322786944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264237.584965:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322786944:0@lo:400:kworker.0 00010000:00080000:1.0:1789264237.584978:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983620700 x1876179322787456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264237.584995:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322787456:0@lo:400:kworker.0 00000100:00100000:1.0:1789264237.585011:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322786304:0@lo:400:kworker.0 00000100:00100000:1.0:1789264237.585021:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322786816:0@lo:400:kworker.0 00000100:00100000:1.0:1789264237.585031:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1876179322787328:0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.585244:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322786176:0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.585301:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264237.585337:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322786688:0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.585373:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264237.585391:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322787200:0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.585412:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264237.585428:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322787712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264237.585462:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264237.585485:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789264237.585491:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322786560:0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.585511:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264237.585526:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322787072:0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.585543:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264237.585559:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322787584:0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.585591:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264237.585622:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322786176 00000100:00100000:2.0:1789264237.585628:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322786176 00000100:00100000:2.0:1789264237.585670:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789264237.585680:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3623:x1876179322786176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.585725:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3623:x1876179322786176:12345-0@lo:400:kworker.0 Request processed in 47us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264237.585732:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789264237.585786:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322786432 00000100:00100000:2.0:1789264237.585791:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322786432 00000100:00100000:2.0:1789264237.585816:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322786688 00000100:00100000:2.0:1789264237.585819:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322786688 00000100:00100000:2.0:1789264237.586079:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789264237.586089:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322786432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.586137:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322786432:12345-0@lo:400:kworker.0 Request processed in 51us (7340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264237.586150:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789264237.586166:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789264237.586172:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322786688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.586203:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322786688:12345-0@lo:400:kworker.0 Request processed in 31us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264237.586209:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789264237.586228:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322787200 00000100:00100000:2.0:1789264237.586231:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322787200 00000100:00100000:2.0:1789264237.586262:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322787072 00000100:00100000:2.0:1789264237.586265:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322787072 00000100:00100000:2.0:1789264237.586281:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322787584 00000100:00100000:2.0:1789264237.586284:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322787584 00000100:00100000:2.0:1789264237.586300:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789264237.586305:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322787200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.586335:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322787200:12345-0@lo:400:kworker.0 Request processed in 30us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264237.586341:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789264237.586352:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789264237.586357:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322787072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.586382:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322787072:12345-0@lo:400:kworker.0 Request processed in 25us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264237.586388:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789264237.586399:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789264237.586406:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322787584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.586431:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322787584:12345-0@lo:400:kworker.0 Request processed in 26us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264237.586459:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789264237.586479:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322787712 00000100:00100000:2.0:1789264237.586483:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322787712 00000100:00100000:2.0:1789264237.586507:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789264237.586513:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322787712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789264237.586528:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789264237.586562:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322787712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264237.586568:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789264237.586586:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322786560 00000100:00100000:2.0:1789264237.586590:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322786560 00000100:00100000:2.0:1789264237.586616:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789264237.586622:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322786560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.586652:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322786560:12345-0@lo:400:kworker.0 Request processed in 30us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264237.586658:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789264237.586712:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322786560:0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.586724:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322787072:0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.586732:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967314 gen 2 00000004:00080000:2.0:1789264237.586737:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c39836fea00, transno 4294967311 00000004:00080000:2.0:1789264237.586767:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967314 00000004:00080000:2.0:1789264237.586784:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c3ab301ed80, transno 4294967314 00000100:00100000:2.0:1789264237.586789:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322787584:0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.586802:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322786176:0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.586824:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322786688:0@lo:400:kworker.0 00000100:00080000:1.0:1789264237.586947:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789264237.586952:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264237.586976:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322786432:0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.587161:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322787200:0@lo:400:kworker.0 00000100:00100000:2.0:1789264237.587184:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322787712:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789264237.592850:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1789264237.592862:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789264237.593003:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789264237.593013:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:1.0:1789264237.855244:0:14519:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:50:37 (1789264237) 00000100:00100000:3.0:1789264238.090793:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789264238.090816:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322787840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789264238.090936:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264238.091080:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322787840 00000100:00100000:2.0:1789264238.091089:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322787840 00000100:00100000:2.0:1789264238.091157:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789264238.091167:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322787840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789264238.091199:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789264238.091454:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322787840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789264238.091505:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322787840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 339us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264238.091512:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00010000:00010000:3.0:1789264238.218177:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264238.542896:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264238.542968:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264238.543008:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264238.543057:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264238.543081:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264238.543098:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264238.543115:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264238.543151:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311201280 00000100:00100000:3.0:1789264238.543159:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311201280 00000100:00100000:3.0:1789264238.543205:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 367 00000100:00100000:3.0:1789264238.543215:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2403:x1876179311201280:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264238.543277:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2403:x1876179311201280:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 63us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264238.543285:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 367 00000100:00100000:0.0:1789264238.543594:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311201664 00000100:00100000:0.0:1789264238.543599:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311201664 00000100:00100000:0.0:1789264238.543656:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311201792 00000100:00100000:0.0:1789264238.543659:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311201792 00000100:00100000:0.0:1789264238.543685:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 97 00000100:00100000:0.0:1789264238.543692:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2403:x1876179311201664:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264238.543741:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2403:x1876179311201664:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 49us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264238.543794:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 97 00000100:00100000:0.0:1789264238.543809:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 98 00000100:00100000:0.0:1789264238.543815:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2403:x1876179311201792:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264238.543842:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2403:x1876179311201792:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 27us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264238.543847:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 98 00000100:00100000:0.0:1789264238.543875:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311201408 00000100:00100000:0.0:1789264238.543879:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311201408 00000100:00100000:0.0:1789264238.543904:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311201920 00000100:00100000:0.0:1789264238.543913:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311201920 00000100:00100000:0.0:1789264238.543931:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311201536 00000100:00100000:0.0:1789264238.543934:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311201536 00000100:00100000:0.0:1789264238.543945:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311202048 00000100:00100000:0.0:1789264238.543948:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311202048 00000100:00100000:0.0:1789264238.543962:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 233 00000100:00100000:0.0:1789264238.543968:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+13:2403:x1876179311201408:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264238.544001:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 234 00000100:00100000:0.0:1789264238.544003:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+13:2403:x1876179311201408:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 34us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264238.544013:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 233 00000100:00100000:1.0:1789264238.544017:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2403:x1876179311201920:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264238.544034:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 235 00000100:00100000:0.0:1789264238.544043:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2403:x1876179311201536:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264238.544057:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2403:x1876179311201920:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 45us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264238.544064:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 234 00000100:00100000:0.0:1789264238.544077:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2403:x1876179311201536:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 35us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264238.544083:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 236 00000100:00100000:1.0:1789264238.544091:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2403:x1876179311202048:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264238.544121:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2403:x1876179311202048:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 31us (1005us total) trans 0 rc 0/0 00000100:00080000:3.0:1789264238.544233:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789264238.544237:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789264238.544240:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789264238.544242:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264238.547356:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 235 00000100:00100000:1.0:1789264238.548895:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 236 00000100:00100000:3.0:1789264238.883200:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264238.883363:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311202304 00000100:00100000:0.0:1789264238.883373:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311202304 00000100:00100000:0.0:1789264238.883442:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 149 00000100:00100000:0.0:1789264238.883452:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+13:12134:x1876179311202304:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264238.883470:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264238.883503:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed75cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac6d expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883568:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75d3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883582:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883607:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883630:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed75da lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883638:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed75da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883644:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed75da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883731:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed75e1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883739:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed75e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883774:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed75e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264238.883783:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789264238.883873:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883880:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75d3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883887:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883893:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ae00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264238.883902:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883910:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75d3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883921:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c39824a1300) 00010000:00010000:0.0:1789264238.883924:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264238.883928:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883935:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed75d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883946:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed75da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883951:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed75da lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883957:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed75da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883962:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366a000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264238.883965:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed75da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883971:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed75da lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883977:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c398249ee00) 00010000:00010000:0.0:1789264238.883979:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264238.883985:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed75da lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.883992:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed75da lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.884237:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed75cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac6d expref: 16 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.884250:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed75e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac6d expref: 15 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264238.884257:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e7c300) 00010000:00010000:0.0:1789264238.884260:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264238.884264:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366b400, rc 0) 00000100:00100000:0.0:1789264238.884326:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+15:12134:x1876179311202304:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 876us (1134us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789264238.884332:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 149 00000100:00100000:0.0:1789264238.892301:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264238.892346:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264238.892426:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311202560 00000100:00100000:2.0:1789264238.892447:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311202560 00000100:00100000:2.0:1789264238.892502:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 150 00000100:00100000:2.0:1789264238.892512:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+15:12134:x1876179311202560:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789264238.892607:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+15:12134:x1876179311202560:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 Request processed in 97us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264238.892615:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 150 00000100:00100000:1.0:1789264238.892879:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311202432 00000100:00100000:1.0:1789264238.892883:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311202432 00000100:00100000:1.0:1789264238.892924:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:1.0:1789264238.892942:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+15:2403:x1876179311202432:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264238.892952:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264238.892973:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed75e1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac6d expref: 15 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264238.892991:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e7c300) 00010000:00010000:1.0:1789264238.892995:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264238.893013:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+14:2403:x1876179311202432:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 73us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264238.893019:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:1.0:1789264238.902641:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264238.902730:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311202688 00000100:00100000:2.0:1789264238.902739:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311202688 00000100:00100000:2.0:1789264238.902816:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 151 00000100:00100000:2.0:1789264238.902826:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:12134:x1876179311202688:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789264238.902924:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:12134:x1876179311202688:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 Request processed in 99us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264238.902946:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 151 00010000:00010000:2.0:1789264239.241901:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789264239.312600:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789264239.881951:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789264239.881961:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789264239.881980:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789264239.881998:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789264240.138088:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322787968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789264240.138160:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264240.138292:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322787968 00000100:00100000:0.0:1789264240.138301:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322787968 00000100:00100000:0.0:1789264240.138361:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789264240.138371:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322787968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789264240.138398:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264240.138473:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322787968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264240.138481:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789264240.138529:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322787968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789264240.138845:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322788096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789264240.138878:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789264240.139060:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264240.139108:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322788096 00000100:00100000:0.0:1789264240.139114:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322788096 00000100:00100000:0.0:1789264240.139165:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789264240.139172:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322788096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789264240.139185:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789264240.139223:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322788096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264240.139230:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789264240.139261:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322788096:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789264240.139431:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789264240.269840:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264240.393354:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264240.393438:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311202816 00000100:00100000:2.0:1789264240.393448:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311202816 00000100:00100000:2.0:1789264240.393516:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 152 00000100:00100000:2.0:1789264240.393526:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+14:12176:x1876179311202816:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264240.393545:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264240.393583:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed75ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac74 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393643:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed75f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393657:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed75f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393669:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed75f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393684:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed75fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393691:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed75fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393709:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed75fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393785:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed75f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393792:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed75f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393799:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed75f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393804:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1ce00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264240.393809:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed75f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393815:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed75f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393826:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c39824a1a00) 00010000:00010000:2.0:1789264240.393829:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264240.393834:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed75f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393839:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed75f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393850:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed75fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393856:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed75fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393869:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed75fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393874:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1cc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264240.393877:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed75fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393883:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed75fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393890:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c3aa98f2d00) 00010000:00010000:2.0:1789264240.393892:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264240.393895:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed75fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393900:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed75fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393930:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed75ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac74 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393939:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c39824a1a00) 00010000:00010000:2.0:1789264240.393942:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264240.393945:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed75ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac74 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.393953:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1dc00, rc 0) 00000100:00100000:2.0:1789264240.394010:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+14:12176:x1876179311202816:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 486us (665us total) trans 0 rc 301/301 00000100:00100000:2.0:1789264240.394025:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 152 00000100:00080000:3.0:1789264240.394396:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789264240.401593:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264240.401677:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311203072 00000100:00100000:1.0:1789264240.401687:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311203072 00000100:00100000:1.0:1789264240.401770:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 153 00000100:00100000:1.0:1789264240.401780:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+14:12176:x1876179311203072:12345-192.168.203.44@tcp:36:lfs.0 00010000:00010000:1.0:1789264240.401832:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264240.401861:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed6f43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa98 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.401881:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c39824a1a00) 00010000:00010000:1.0:1789264240.401887:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789264240.401960:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.401975:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed75c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac66 expref: 5 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.401995:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.402842:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed75c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac66 expref: 5 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.402862:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed75c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac66 expref: 5 pid: 6492 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264240.402877:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322788224:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264240.402999:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264240.409722:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264240.409783:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311203200 00000100:00100000:2.0:1789264240.409792:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311203200 00010000:00010000:2.0:1789264240.409841:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed75c5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac66 expref: 6 pid: 6492 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264240.409886:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 80 00000100:00100000:2.0:1789264240.409895:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2402:x1876179311203200:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264240.409910:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264240.409917:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed75c5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac66 expref: 6 pid: 6492 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.409931:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed75c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac66 expref: 6 pid: 6492 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.409954:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c39824a1a00) 00010000:00010000:2.0:1789264240.409960:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.409971:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.409978:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.409996:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264240.410048:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2402:x1876179311203200:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 154us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264240.410063:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 80 00000100:00080000:2.0:1789264240.410088:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789264240.410736:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c400/0xecaf9f2f14ed75c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac66 expref: 5 pid: 6492 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264240.410776:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322788224:192.168.203.44@tcp:104: 00010000:00010000:0.0:1789264240.410797:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.410806:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.410813:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.410833:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed760b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.410851:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed760b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.410859:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed760b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.411352:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7612 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.411362:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7612 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.411369:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7612 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789264240.411383:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092c52f34 reply state 00000000017684be transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7612 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.411393:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7612 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.411400:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:0.0:1789264240.411403:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789264240.411406:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789264240.411411:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789264240.411418:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.411437:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.411445:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.411458:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45c00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264240.411462:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.411469:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.411480:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c39824a1a00) 00010000:00010000:0.0:1789264240.411482:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264240.411486:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.411491:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7604 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789264240.411506:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092c52f34 reply state 00000000017684be transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed760b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.411514:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed760b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.411519:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c398249ea00) 00010000:00010000:0.0:1789264240.411522:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789264240.411524:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789264240.411597:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+15:12176:x1876179311203072:12345-192.168.203.44@tcp:36:lfs.0 Request processed in 9817us (10012us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789264240.411605:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 153 00000100:00100000:2.0:1789264240.510781:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264240.510879:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311203328 00000100:00100000:0.0:1789264240.510889:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311203328 00000100:00100000:0.0:1789264240.510950:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 154 00000100:00100000:0.0:1789264240.510975:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+15:12184:x1876179311203328:12345-192.168.203.44@tcp:101:lctl.0 00010000:00010000:0.0:1789264240.511000:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264240.511022:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7619 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac7b expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.511087:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7620 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.511100:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.511111:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264240.511155:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789264240.511159:0:7904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789264240.511178:0:7904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.511203:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7619 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac7b expref: 17 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.511223:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7620 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac7b expref: 16 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.511231:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c398249eb00) 00010000:00010000:0.0:1789264240.511234:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789264240.511237:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366b400, rc 0) 00000100:00100000:0.0:1789264240.511341:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+16:12184:x1876179311203328:12345-192.168.203.44@tcp:101:lctl.0 Request processed in 368us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264240.511359:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 154 00000100:00100000:2.0:1789264240.565621:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264240.565728:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311203456 00000100:00100000:0.0:1789264240.565739:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311203456 00000100:00100000:0.0:1789264240.565832:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 155 00000100:00100000:0.0:1789264240.565842:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+16:12190:x1876179311203456:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1789264240.565860:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264240.565878:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7627 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac82 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.565952:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed762e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.565965:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed762e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.565976:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed762e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.565986:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7635 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.565993:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7635 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.565999:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7635 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566080:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed763c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566105:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed763c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566111:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed763c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264240.566143:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789264240.566146:0:9197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789264240.566165:0:9197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed763c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566176:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed762e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566182:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed762e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566188:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed762e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566194:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264240.566198:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed762e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566205:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed762e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566216:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c398249eb00) 00010000:00010000:0.0:1789264240.566218:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264240.566222:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed762e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566236:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed762e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566250:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7635 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566256:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7635 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566262:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7635 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566267:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264240.566270:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7635 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566276:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7635 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566283:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c398249ea00) 00010000:00010000:0.0:1789264240.566285:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264240.566288:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7635 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566293:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7635 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566318:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed7627 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac82 expref: 18 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566332:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed763c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac82 expref: 17 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.566346:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:0.0:1789264240.566349:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789264240.566351:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366ba00, rc 0) 00000100:00100000:0.0:1789264240.566414:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+17:12190:x1876179311203456:12345-192.168.203.44@tcp:101:bash.0 Request processed in 572us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264240.566431:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 155 00000100:00100000:0.0:1789264240.576471:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264240.576618:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311203712 00000100:00100000:3.0:1789264240.576628:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311203712 00000100:00100000:3.0:1789264240.576701:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 156 00000100:00100000:3.0:1789264240.576712:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+17:12190:x1876179311203712:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1789264240.576736:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264240.576781:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7643 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac89 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.576892:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed764a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.576905:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed764a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.576915:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed764a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.576986:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7651 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.577005:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7651 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.577013:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7651 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789264240.578168:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789264240.578304:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7658 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.578316:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7658 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.578326:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7658 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.578357:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed764a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.578364:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed764a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.578370:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed764a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.578376:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36ac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264240.578380:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed764a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.578387:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed764a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.578415:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:3.0:1789264240.578417:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264240.578432:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed764a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.578437:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed764a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789264240.578450:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c99df61f reply state 00000000a172f8e5 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7651 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.578460:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7651 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.578466:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c3983364400) 00010000:00010000:3.0:1789264240.578467:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789264240.578470:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789264240.578503:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7643 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac89 expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.578518:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7658 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac89 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.578524:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3983364900) 00010000:00010000:3.0:1789264240.578526:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789264240.578529:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36aa00, rc 0) 00000100:00100000:3.0:1789264240.578609:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+20:12190:x1876179311203712:12345-192.168.203.44@tcp:101:bash.0 Request processed in 1899us (2144us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789264240.578617:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 156 00000100:00100000:2.0:1789264240.582727:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264240.582926:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311203840 00000100:00100000:1.0:1789264240.583003:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311203840 00000100:00100000:0.0:1789264240.583162:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:0.0:1789264240.583173:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311203840:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1789264240.583191:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264240.583208:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7666 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac90 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789264240.583232:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264240.583250:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1789264240.583254:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264240.583263:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7666 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac90 expref: 6 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.583283:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7666 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac90 expref: 6 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.583297:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366bc00, rc 0) 00000100:00100000:0.0:1789264240.583416:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311203840:12345-192.168.203.44@tcp:101:bash.0 Request processed in 244us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264240.583446:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00080000:2.0:1789264240.583508:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264240.586374:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264240.586468:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311203968 00000100:00100000:2.0:1789264240.586477:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311203968 00000100:00100000:2.0:1789264240.586536:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:2.0:1789264240.586546:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:12190:x1876179311203968:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1789264240.586562:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264240.586579:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac97 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.586608:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7666 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac90 expref: 7 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.586618:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264240.586622:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264240.586627:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.586660:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7666 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac90 expref: 7 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.586673:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7666 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac90 expref: 7 pid: 8406 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264240.586700:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8403:1876179322788352:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264240.586819:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52900 going to sleep for 11 seconds 00000100:00100000:3.0:1789264240.590824:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264240.590938:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311204096 00000100:00100000:1.0:1789264240.590950:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311204096 00010000:00010000:1.0:1789264240.590998:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7666 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac90 expref: 8 pid: 8406 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264240.591039:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 81 00000100:00100000:1.0:1789264240.591050:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983620700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2403:x1876179311204096:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264240.591068:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264240.591104:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7666 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac90 expref: 8 pid: 8406 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.591121:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7666 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac90 expref: 8 pid: 8406 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.591187:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264240.591193:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264240.591204:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.591217:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.591234:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008513aff8/0xecaf9f2f14ed7666 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac90 expref: 8 pid: 8406 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264240.591264:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8403:1876179322788352:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264240.591271:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264240.591294:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6475:1876179322788480:192.168.203.44@tcp:105: 00010000:00010000:2.0:1789264240.591308:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.591327:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1ce00, rc 0) 00000100:00100000:1.0:1789264240.591413:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264240.591549:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:12190:x1876179311203968:12345-192.168.203.44@tcp:101:bash.0 Request processed in 5001us (5179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264240.591560:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:1.0:1789264240.594486:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6475:1876179322788480:192.168.203.44@tcp:105: 00010000:00010000:1.0:1789264240.594528:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264240.594599:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983620700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2403:x1876179311204096:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 3548us (3786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264240.594612:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 81 00000100:00100000:3.0:1789264240.596695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264240.599156:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311204352 00000100:00100000:1.0:1789264240.599176:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311204352 00000100:00100000:1.0:1789264240.600109:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:1.0:1789264240.600123:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+20:12190:x1876179311204352:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:1.0:1789264240.601295:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+21:12190:x1876179311204352:12345-192.168.203.44@tcp:35:bash.0 Request processed in 1167us (4605us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789264240.601331:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:2.0:1789264240.651793:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789264240.651823:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322788608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789264240.651899:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264240.652195:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322788608 00000100:00100000:0.0:1789264240.652204:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322788608 00000100:00100000:0.0:1789264240.652265:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789264240.652275:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322788608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789264240.652308:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789264240.652372:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322788608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264240.652381:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789264240.652469:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322788608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789264240.692434:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264240.693465:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311204608 00000100:00100000:2.0:1789264240.693480:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311204608 00000100:00100000:2.0:1789264240.693557:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 157 00000100:00100000:2.0:1789264240.693568:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+21:12200:x1876179311204608:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264240.693594:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264240.693614:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7674 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdac9e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264240.693736:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789264240.693862:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7674 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac9e expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.693877:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c398249eb00) 00010000:00010000:2.0:1789264240.693879:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789264240.693885:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7674 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac9e expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.693899:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1cc00, rc 0) 00000100:00100000:2.0:1789264240.693978:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+22:12200:x1876179311204608:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 412us (1566us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1789264240.693986:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 157 00000100:00100000:3.0:1789264240.697836:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264240.697971:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311204864 00000100:00100000:0.0:1789264240.697987:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311204864 00000100:00100000:0.0:1789264240.698166:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 37 00000100:00100000:0.0:1789264240.698180:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+22:12200:x1876179311204864:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1789264240.698603:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+23:12200:x1876179311204864:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 425us (777us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789264240.698611:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 37 00000100:00100000:3.0:1789264240.787019:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264240.787144:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311204992 00000100:00100000:2.0:1789264240.787156:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311204992 00000100:00100000:2.0:1789264240.787230:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 158 00000100:00100000:2.0:1789264240.787240:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+23:12206:x1876179311204992:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264240.787407:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264240.787442:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7682 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaca5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.787524:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7689 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.787540:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.787577:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264240.787629:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789264240.787633:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264240.787655:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.787683:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7682 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaca5 expref: 25 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.787702:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7689 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaca5 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.787712:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:2.0:1789264240.787715:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789264240.787718:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1dc00, rc 0) 00000100:00100000:2.0:1789264240.787838:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+24:12206:x1876179311204992:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 599us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264240.787845:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 158 00000100:00100000:3.0:1789264240.794286:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264240.796563:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311205248 00000100:00100000:0.0:1789264240.796586:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311205248 00000100:00100000:0.0:1789264240.796683:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 159 00000100:00100000:0.0:1789264240.796695:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+24:12206:x1876179311205248:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264240.797831:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264240.797868:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7690 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdacac expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.798102:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7697 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.798139:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.798154:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264240.798169:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789264240.798520:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed7690 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacac expref: 27 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.798543:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacac expref: 26 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.798553:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3983364900) 00010000:00010000:0.0:1789264240.798557:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789264240.798561:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366b000, rc 0) 00000100:00100000:0.0:1789264240.798651:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+26:12206:x1876179311205248:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1958us (4390us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1789264240.798661:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 159 00000100:00100000:3.0:1789264240.805779:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264240.809374:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264240.810081:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311205632 00000100:00100000:0.0:1789264240.810097:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311205632 00000100:00100000:0.0:1789264240.810179:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 160 00000100:00100000:0.0:1789264240.810203:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+26:12206:x1876179311205632:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264240.810235:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264240.810275:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed76a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdacb3 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.810457:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed76ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.810478:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed76ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.810493:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed76ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264240.810507:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789264240.810925:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ac00/0xecaf9f2f14ed76a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacb3 expref: 29 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.810947:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed76ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacb3 expref: 28 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.810958:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3983364900) 00010000:00010000:0.0:1789264240.810962:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789264240.810966:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366bc00, rc 0) 00000100:00100000:0.0:1789264240.811053:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+28:12206:x1876179311205632:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 863us (1698us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1789264240.811061:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 160 00000100:00100000:1.0:1789264240.814988:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311205376 00000100:00100000:1.0:1789264240.815009:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311205376 00000100:00100000:1.0:1789264240.815225:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:1.0:1789264240.815238:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+28:2403:x1876179311205376:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264240.815260:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264240.815304:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b000/0xecaf9f2f14ed7697 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacac expref: 28 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.815330:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3983364900) 00010000:00010000:1.0:1789264240.815336:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264240.815426:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+27:2403:x1876179311205376:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 182us (9653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264240.815435:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:3.0:1789264240.819953:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264240.820451:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311205760 00000100:00100000:2.0:1789264240.820467:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311205760 00000100:00100000:2.0:1789264240.820549:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:2.0:1789264240.820561:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2402:x1876179311205760:12345-192.168.203.44@tcp:1:lfs.0 00010000:00010000:2.0:1789264240.820633:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed76ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.820661:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.820691:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789264240.820697:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789264240.820702:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed76ba lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.820791:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.820809:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 6 pid: 8403 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264240.820827:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1876179322788736:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264240.820946:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52900 going to sleep for 11 seconds 00000100:00100000:0.0:1789264240.826523:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1876179322788736:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264240.826610:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00010000:00010000:0.0:1789264240.827918:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed76ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264240.828154:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311205888 00000100:00100000:3.0:1789264240.828166:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311205888 00002000:00100000:3.0:1789264240.828385:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9c3983f51180 x1876179311205888/t0(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:321/0 lens 504/0 e 0 to 0 dl 1789264251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789264240.828397:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3983f51180 with x1876179311205888 ext(0->12) 00010000:00010000:3.0:1789264240.828407:0:8409:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 7 pid: 8403 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.828435:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 7 pid: 8403 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789264240.828445:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c3983f51180 00000100:00100000:3.0:1789264240.828489:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:3.0:1789264240.828503:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2403:x1876179311205888:12345-192.168.203.44@tcp:4:lfs.0 00000100:00100000:3.0:1789264240.833318:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2403:x1876179311205888:12345-192.168.203.44@tcp:4:lfs.0 Request processed in 4807us (6706us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789264240.833348:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 2 00002000:00100000:3.0:1789264240.833361:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9c3983f51180 x1876179311205888/t4294967306(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:321/0 lens 504/448 e 0 to 0 dl 1789264251 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789264240.833371:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3983f51180 with x1876179311205888 ext(0->12) 00010000:00010000:3.0:1789264240.833381:0:8409:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 9 pid: 8403 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264240.833399:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 9 pid: 8403 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789264240.833407:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c3983f51180 00000100:00100000:0.0:1789264240.837248:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264240.837381:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311206016 00000100:00100000:2.0:1789264240.837390:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311206016 00010000:00010000:2.0:1789264240.837443:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 9 pid: 8403 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264240.837522:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 82 00000100:00100000:2.0:1789264240.837533:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2402:x1876179311206016:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264240.837549:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789264240.837568:0:8420:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789264240.837571:0:8420:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789264240 00002000:00010000:2.0:1789264240.837580:0:8420:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789264241 00002000:00010000:2.0:1789264240.837582:0:8420:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789264240 00002000:00010000:2.0:1789264240.837585:0:8420:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789264240.837591:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 9 pid: 8403 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.837605:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 9 pid: 8403 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.837631:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed766d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac97 expref: 9 pid: 8403 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.837664:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789264240.837669:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789264240.837675:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed76ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.837686:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed76ba lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.837722:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789264240.837816:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed76ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264240.837826:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311206016:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 293us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264240.837853:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 82 00010000:00010000:1.0:1789264240.837856:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed76ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.837893:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed76ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.837904:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed76ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.837936:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed76ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.837945:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1da00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264240.837951:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed76ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.837961:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed76ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.837983:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed76ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.837992:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed76ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264240.838131:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2402:x1876179311205760:12345-192.168.203.44@tcp:1:lfs.0 Request processed in 17569us (18190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264240.838141:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:0.0:1789264240.844565:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264240.845402:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311206272 00000100:00100000:1.0:1789264240.845424:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311206272 00000100:00100000:1.0:1789264240.845546:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 38 00000100:00100000:1.0:1789264240.845560:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab27a7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+27:12206:x1876179311206272:12345-192.168.203.44@tcp:35:lfs.0 00000004:00010000:1.0:1789264240.845640:0:6494:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed76ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacb3 expref: 27 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789264240.846061:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1789264240.846101:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789264240.848051:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1789264240.848115:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.848136:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7658 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac89 expref: 31 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.848144:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.848284:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7658 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac89 expref: 31 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.848302:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7658 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac89 expref: 31 pid: 6492 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264240.848317:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1876179322788864:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264240.848523:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789264240.851832:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264240.851919:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311206400 00000100:00100000:0.0:1789264240.851934:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311206400 00010000:00010000:0.0:1789264240.851987:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7658 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac89 expref: 32 pid: 6492 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264240.852036:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 83 00000100:00100000:0.0:1789264240.852047:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+32:2402:x1876179311206400:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264240.852062:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264240.852070:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7658 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac89 expref: 32 pid: 6492 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.852087:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7658 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac89 expref: 32 pid: 6492 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.852112:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3983364900) 00010000:00010000:0.0:1789264240.852118:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.852128:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.852137:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7658 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac89 expref: 32 pid: 6492 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.852140:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264240.852187:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264240.852255:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+31:2402:x1876179311206400:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 208us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264240.852263:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 83 00000100:00100000:1.0:1789264240.852309:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1876179322788864:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264240.852343:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.853440:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.853448:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789264240.855030:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1789264240.855907:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1789264240.856277:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876179322788992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789264240.856385:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264240.856444:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc300 going to sleep for 11 seconds 00000100:00100000:0.0:1789264240.856655:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322788992 00000100:00100000:0.0:1789264240.856665:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322788992 00000100:00100000:0.0:1789264240.856833:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789264240.856845:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6494:x1876179322788992:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789264240.856955:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6494:x1876179322788992:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 112us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264240.856963:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789264240.857071:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876179322788992:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789264240.857239:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1789264240.857309:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876179322789120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789264240.857339:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264240.857961:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc840 going to sleep for 11 seconds 00000100:00100000:2.0:1789264240.858063:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322789120 00000100:00100000:2.0:1789264240.858071:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322789120 00000100:00100000:2.0:1789264240.858119:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789264240.858128:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6494:x1876179322789120:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789264240.858430:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6494:x1876179322789120:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 302us (1089us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789264240.858439:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789264240.858605:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876179322789120:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789264240.858659:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1789264240.858705:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.858717:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.858726:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.858733:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264240.858909:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.858919:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.858938:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3983364900) 00010000:00010000:1.0:1789264240.858941:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789264240.858946:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.858952:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed76c1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789264240.859139:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789264240.860863:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1789264240.860890:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 321202144697ns, next at 322202137566ns, rc = 0 00000001:00080000:1.0:1789264240.860908:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1789264240.860964:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3983364900) 00010000:00010000:1.0:1789264240.860968:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789264240.860979:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366bc00/0xecaf9f2f14ed76ac lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacb3 expref: 35 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264240.862243:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab27a7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+34:12206:x1876179311206272:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 16679us (17687us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1789264240.862256:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 38 00000020:00080000:1.0:1789264240.862264:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789264240.866057:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264240.866178:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311206528 00000100:00100000:2.0:1789264240.866201:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311206528 00000100:00100000:2.0:1789264240.866279:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 161 00000100:00100000:2.0:1789264240.866290:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+34:12206:x1876179311206528:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264240.866324:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264240.866355:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed76c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdacba expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.866576:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed76c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacba expref: 35 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.866599:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed76c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacba expref: 35 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.866625:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:2.0:1789264240.866629:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789264240.866633:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1ce00, rc 0) 00000100:00100000:2.0:1789264240.866794:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+35:12206:x1876179311206528:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 504us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264240.866802:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 161 00000100:00100000:3.0:1789264240.870376:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264240.870472:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311206784 00000100:00100000:0.0:1789264240.870486:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311206784 00000100:00100000:0.0:1789264240.870571:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:0.0:1789264240.870582:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+35:12206:x1876179311206784:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1789264240.870974:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+36:12206:x1876179311206784:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 393us (611us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789264240.870982:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:2.0:1789264240.938405:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264240.938526:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311207040 00000100:00100000:0.0:1789264240.938540:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311207040 00000100:00100000:0.0:1789264240.938616:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 162 00000100:00100000:0.0:1789264240.938629:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+36:12216:x1876179311207040:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264240.938661:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264240.938689:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb600/0xecaf9f2f14ed76cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdacc1 expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264240.938866:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789264240.939116:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb600/0xecaf9f2f14ed76cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacc1 expref: 38 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.939161:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c398249eb00) 00010000:00010000:1.0:1789264240.939164:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789264240.939170:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb600/0xecaf9f2f14ed76cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacc1 expref: 38 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264240.939249:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836cb600, rc 0) 00000100:00100000:1.0:1789264240.939391:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+37:12216:x1876179311207040:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 763us (999us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1789264240.939399:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 162 00000100:00100000:2.0:1789264240.945138:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264240.945782:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311207168 00000100:00100000:3.0:1789264240.945797:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311207168 00000100:00100000:2.0:1789264240.946614:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 163 00000100:00100000:2.0:1789264240.946628:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+37:12216:x1876179311207168:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:2.0:1789264240.946757:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed76dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.946779:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed76dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.946794:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed76dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.946808:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.946816:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.946823:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.946930:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed76eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.946939:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed76eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.946947:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed76eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789264240.947047:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed76eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947064:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed76dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947083:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed76dd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947090:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed76dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947097:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1de00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264240.947103:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed76dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947111:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed76dd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947127:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:2.0:1789264240.947130:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264240.947135:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed76dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947142:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed76dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947157:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947164:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947170:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947174:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264240.947183:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947190:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947199:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c3983364400) 00010000:00010000:2.0:1789264240.947201:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264240.947204:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947211:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947222:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed76eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947227:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed76eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947232:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed76eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947236:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1d800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264240.947239:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed76eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947245:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed76eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947251:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:2.0:1789264240.947253:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264240.947262:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed76eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.947268:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed76eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264240.947383:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+37:12216:x1876179311207168:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 756us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264240.947391:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 163 00000100:00100000:3.0:1789264240.950679:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264240.951016:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311207424 00000100:00100000:0.0:1789264240.951029:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311207424 00000100:00100000:0.0:1789264240.951100:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:0.0:1789264240.951111:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+37:12216:x1876179311207424:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1789264240.951447:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+38:12216:x1876179311207424:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 332us (778us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789264240.951456:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:0.0:1789264240.996945:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264240.997902:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311207680 00000100:00100000:2.0:1789264240.997919:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311207680 00000100:00100000:2.0:1789264240.998021:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 164 00000100:00100000:2.0:1789264240.998034:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+38:12219:x1876179311207680:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264240.998068:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264240.998094:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed76f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdacc8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.998229:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.998248:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.998263:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.998278:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7700 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.998286:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7700 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.998317:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7700 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.998473:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed7707 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.998483:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed7707 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.998491:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed7707 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264240.998502:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789264240.998616:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.998625:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.998631:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.998638:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264240.998643:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.998653:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.998666:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:2.0:1789264240.998669:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264240.999798:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.999809:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed76f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.999832:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7700 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.999838:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7700 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.999845:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7700 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.999852:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1de00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264240.999856:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7700 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.999862:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7700 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.999877:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c3983364400) 00010000:00010000:2.0:1789264240.999880:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264240.999883:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7700 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.999889:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7700 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264240.999953:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed76f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacc8 expref: 41 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.001132:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed7707 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacc8 expref: 40 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.001164:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:2.0:1789264241.001167:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789264241.001172:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c800, rc 0) 00000100:00100000:2.0:1789264241.001827:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+40:12219:x1876179311207680:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 3790us (4890us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789264241.001839:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 164 00000100:00100000:2.0:1789264241.006851:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264241.007534:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311207808 00000100:00100000:1.0:1789264241.007549:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311207808 00000100:00100000:1.0:1789264241.007626:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 165 00000100:00100000:1.0:1789264241.007638:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+40:12219:x1876179311207808:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:1.0:1789264241.007856:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7715 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264241.007877:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7715 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264241.007891:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7715 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264241.007935:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7715 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264241.007943:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7715 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264241.007972:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7715 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264241.007979:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264241.007983:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7715 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264241.008003:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7715 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264241.008027:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:1.0:1789264241.008031:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789264241.008037:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7715 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264241.008044:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7715 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264241.008147:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+40:12219:x1876179311207808:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 509us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264241.008167:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 165 00000100:00100000:0.0:1789264241.013965:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264241.014082:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311208064 00000100:00100000:2.0:1789264241.014095:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311208064 00000100:00100000:2.0:1789264241.014348:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:2.0:1789264241.014361:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+40:12219:x1876179311208064:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:2.0:1789264241.015020:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+41:12219:x1876179311208064:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 652us (1060us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789264241.015029:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:0.0:1789264241.245917:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264241.245976:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311208320 00000100:00100000:3.0:1789264241.245990:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311208320 00000100:00100000:3.0:1789264241.246205:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 166 00000100:00100000:3.0:1789264241.246222:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+41:12250:x1876179311208320:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:3.0:1789264241.246256:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264241.246285:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed771c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaccf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.246510:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7723 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.246545:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7723 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.246560:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7723 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264241.246575:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789264241.246706:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed771c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaccf expref: 44 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.246728:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7723 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaccf expref: 43 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.246738:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264241.246740:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789264241.246812:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b800, rc 0) 00000100:00100000:3.0:1789264241.246932:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+43:12250:x1876179311208320:12345-192.168.203.44@tcp:101:cat.0 Request processed in 714us (1025us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789264241.246940:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 166 00000100:00100000:0.0:1789264241.255785:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264241.256386:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311208576 00000100:00100000:3.0:1789264241.256406:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311208576 00000100:00100000:3.0:1789264241.256562:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:3.0:1789264241.256578:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+43:12250:x1876179311208576:12345-192.168.203.44@tcp:35:cat.0 00000100:00100000:0.0:1789264241.256989:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264241.257112:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311208704 00000100:00100000:1.0:1789264241.257119:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311208704 00000100:00100000:1.0:1789264241.257197:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:1.0:1789264241.257224:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+45:2402:x1876179311208704:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264241.257238:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264241.257305:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7723 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaccf expref: 45 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264241.257352:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:1.0:1789264241.257358:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264241.257444:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+44:2402:x1876179311208704:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 238us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264241.257453:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:3.0:1789264241.257529:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+43:12250:x1876179311208576:12345-192.168.203.44@tcp:35:cat.0 Request processed in 955us (1797us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789264241.257538:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 42 00010000:00010000:3.0:1789264241.290002:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264241.334237:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264241.334342:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311208960 00000100:00100000:2.0:1789264241.334355:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311208960 00000100:00100000:2.0:1789264241.334440:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 167 00000100:00100000:2.0:1789264241.334452:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+43:12256:x1876179311208960:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:2.0:1789264241.334552:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264241.334556:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789264241.334592:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7689 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaca5 expref: 43 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.334640:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:2.0:1789264241.334646:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789264241.334665:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7731 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdacd6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.334853:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.334869:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed7707 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacc8 expref: 43 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.334879:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.334919:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed7707 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacc8 expref: 43 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.334937:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed7707 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacc8 expref: 43 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264241.334953:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876179322789248:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264241.335080:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789264241.338639:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876179322789248:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264241.338681:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264241.339220:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264241.339298:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311209088 00000100:00100000:2.0:1789264241.339324:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311209088 00010000:00010000:2.0:1789264241.339369:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed7707 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacc8 expref: 44 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264241.339424:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 84 00000100:00100000:2.0:1789264241.339435:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+44:2403:x1876179311209088:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264241.339453:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264241.339461:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed7707 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacc8 expref: 44 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.339485:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed7707 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacc8 expref: 44 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.339512:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c800/0xecaf9f2f14ed7707 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacc8 expref: 44 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.339531:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:2.0:1789264241.339536:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.339546:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.339555:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.339589:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789264241.339628:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.339640:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264241.339663:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000100:00100000:2.0:1789264241.339664:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+43:2403:x1876179311209088:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 228us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264241.339690:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 84 00010000:00010000:3.0:1789264241.339865:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d800/0xecaf9f2f14ed7731 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacd6 expref: 44 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.339884:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacd6 expref: 43 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.339893:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264241.339896:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789264241.339898:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1de00, rc 0) 00000100:00100000:3.0:1789264241.339929:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+43:12256:x1876179311208960:12345-192.168.203.44@tcp:101:dd.0 Request processed in 5479us (5705us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789264241.339937:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 167 00000100:00100000:1.0:1789264241.348735:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264241.348853:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311209216 00000100:00100000:3.0:1789264241.348867:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311209216 00000100:00100000:3.0:1789264241.348951:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 168 00000100:00100000:3.0:1789264241.348963:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+43:12256:x1876179311209216:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:3.0:1789264241.348994:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264241.349031:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7746 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdacdd expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.349078:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed774d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.349115:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed774d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.349130:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed774d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.349278:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7746 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacdd expref: 45 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.349300:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed774d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacdd expref: 44 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.349311:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264241.349314:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789264241.349318:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36ac00, rc 0) 00000100:00100000:3.0:1789264241.349396:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+44:12256:x1876179311209216:12345-192.168.203.44@tcp:101:dd.0 Request processed in 435us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264241.349405:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 168 00000100:00100000:1.0:1789264241.354926:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264241.355182:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311209472 00000100:00100000:3.0:1789264241.355196:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311209472 00000100:00100000:3.0:1789264241.355268:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 169 00000100:00100000:3.0:1789264241.355283:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+44:12256:x1876179311209472:12345-192.168.203.44@tcp:36:dd.0 00010000:00010000:3.0:1789264241.355587:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7754 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.355608:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7754 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.355646:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7754 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789264241.355702:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1789264241.355731:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000291233ac reply state 0000000016e1ed3b transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7754 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.355904:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7754 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.355912:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264241.355915:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789264241.355919:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789264241.356331:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+47:12256:x1876179311209472:12345-192.168.203.44@tcp:36:dd.0 Request processed in 1049us (1415us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1789264241.356342:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 169 00000020:00080000:3.0:1789264241.356348:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789264241.603314:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264241.603469:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311209600 00000100:00100000:3.0:1789264241.603483:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311209600 00000100:00100000:3.0:1789264241.603572:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 170 00000100:00100000:3.0:1789264241.603584:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+47:12270:x1876179311209600:12345-192.168.203.44@tcp:101:stat.0 00010000:00010000:3.0:1789264241.603616:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264241.603641:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed775b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdace4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.603724:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7762 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.603781:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7762 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.603815:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7762 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.603829:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7769 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.603836:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.603842:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.603929:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7770 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.603941:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacd6 expref: 48 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.603950:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7770 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.603991:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacd6 expref: 48 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.604132:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacd6 expref: 48 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264241.604150:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39845ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876179322789376:192.168.203.44@tcp:104: 00000100:00100000:3.0:1789264241.604286:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab6805c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264241.612701:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264241.612814:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311209856 00000100:00100000:2.0:1789264241.612829:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311209856 00000100:00100000:2.0:1789264241.612912:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:2.0:1789264241.612934:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+49:6163:x1876179311209856:12345-192.168.203.44@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789264241.613217:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+50:6163:x1876179311209856:12345-192.168.203.44@tcp:35:ldlm_bl.0 Request processed in 285us (532us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789264241.613225:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:3.0:1789264241.613329:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39845ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876179322789376:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264241.613375:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7770 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264241.620942:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264241.621730:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311209984 00000100:00100000:2.0:1789264241.621786:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311209984 00010000:00010000:2.0:1789264241.621837:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacd6 expref: 50 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264241.621882:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 85 00000100:00100000:2.0:1789264241.621893:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983620700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+50:2403:x1876179311209984:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264241.621908:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264241.621915:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacd6 expref: 50 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.621930:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacd6 expref: 50 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.621953:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7738 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacd6 expref: 50 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.621972:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:2.0:1789264241.621991:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7770 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.622001:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7770 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.622008:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7770 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264241.622039:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264241.622099:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983620700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+49:2403:x1876179311209984:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 208us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264241.622108:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 85 00010000:00010000:3.0:1789264241.622144:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7770 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622159:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7770 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264241.622248:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789264241.622254:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264241.622281:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7770 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622312:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7770 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622326:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7762 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622334:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7762 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622341:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7762 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622347:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264241.622353:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7762 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622361:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7762 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622397:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:3.0:1789264241.622400:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264241.622407:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7762 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622424:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed7762 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622444:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622451:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7769 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622457:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622462:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264241.622465:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622472:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7769 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622479:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c3983364400) 00010000:00010000:3.0:1789264241.622481:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264241.622484:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7769 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622490:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7769 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622699:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed775b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdace4 expref: 49 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622715:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7770 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdace4 expref: 48 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.622723:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264241.622725:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789264241.622728:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b000, rc 0) 00000100:00100000:3.0:1789264241.622854:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+48:12270:x1876179311209600:12345-192.168.203.44@tcp:101:stat.0 Request processed in 19272us (19565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264241.622862:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 170 00000100:00100000:1.0:1789264241.709639:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264241.710869:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311210240 00000100:00100000:2.0:1789264241.710879:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311210240 00000100:00100000:3.0:1789264241.711028:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 171 00000100:00100000:3.0:1789264241.711039:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+48:12276:x1876179311210240:12345-192.168.203.44@tcp:36:truncate.0 00010000:00010000:3.0:1789264241.711102:0:9197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264241.711129:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7770 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdace4 expref: 48 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.711148:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264241.711154:0:9197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789264241.711327:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7777 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.711341:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7777 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.711353:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7777 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789264241.711428:0:9197:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1789264241.711450:0:9197:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a1193af reply state 000000002d6e3b17 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7777 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.711462:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7777 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.711469:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264241.711471:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789264241.711478:0:9197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789264241.711616:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+50:12276:x1876179311210240:12345-192.168.203.44@tcp:36:truncate.0 Request processed in 577us (1984us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789264241.711623:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 171 00000020:00080000:3.0:1789264241.711628:0:9197:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789264241.850691:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264241.850881:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311210368 00000100:00100000:3.0:1789264241.850892:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311210368 00000100:00100000:3.0:1789264241.850991:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 172 00000100:00100000:3.0:1789264241.851003:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+50:12290:x1876179311210368:12345-192.168.203.44@tcp:101:stat.0 00010000:00010000:3.0:1789264241.851027:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264241.851046:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed777e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaceb expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851104:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7785 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851117:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7785 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851127:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7785 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851151:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed778c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851158:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed778c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851164:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed778c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851231:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7793 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851238:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7793 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851244:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7793 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264241.851284:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789264241.851288:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264241.851457:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7793 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851471:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7793 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851479:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7785 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851486:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7785 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851502:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7785 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851508:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264241.851513:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7785 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851521:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7785 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851533:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:3.0:1789264241.851536:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264241.851540:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7785 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851547:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7785 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851560:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed778c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851579:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed778c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851585:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed778c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851596:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264241.851599:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed778c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851615:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed778c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851623:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c3983364400) 00010000:00010000:3.0:1789264241.851625:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264241.851628:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed778c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851634:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed778c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851659:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed777e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaceb expref: 52 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851670:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7793 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaceb expref: 51 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.851676:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264241.851678:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789264241.851681:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b200, rc 0) 00000100:00100000:3.0:1789264241.851794:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+51:12290:x1876179311210368:12345-192.168.203.44@tcp:101:stat.0 Request processed in 794us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264241.851801:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 172 00000100:00100000:2.0:1789264241.922999:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264241.923073:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311210624 00000100:00100000:3.0:1789264241.923083:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311210624 00000100:00100000:3.0:1789264241.923293:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 173 00000100:00100000:3.0:1789264241.923307:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+51:12300:x1876179311210624:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1789264241.923568:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264241.923589:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed779a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdacf2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264241.924007:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789264241.924105:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed779a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacf2 expref: 53 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.924120:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c398249eb00) 00010000:00010000:3.0:1789264241.924124:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789264241.924128:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed779a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacf2 expref: 53 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264241.924142:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b000, rc 0) 00000100:00100000:3.0:1789264241.924320:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+52:12300:x1876179311210624:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1016us (1331us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1789264241.925468:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 173 00000100:00100000:2.0:1789264241.929836:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264241.929905:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311210880 00000100:00100000:0.0:1789264241.929915:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311210880 00000100:00100000:0.0:1789264241.929963:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:0.0:1789264241.929973:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab27a4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+52:12300:x1876179311210880:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1789264241.930204:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab27a4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+53:12300:x1876179311210880:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 232us (376us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1789264241.930212:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:0.0:1789264242.000026:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264242.000951:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311211136 00000100:00100000:2.0:1789264242.000962:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311211136 00000100:00100000:2.0:1789264242.001045:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 174 00000100:00100000:2.0:1789264242.001056:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+53:12306:x1876179311211136:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1789264242.001079:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264242.001101:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed77a8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdacf9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.001203:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.001355:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7793 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaceb expref: 54 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.001384:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.001430:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7793 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaceb expref: 54 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.001444:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7793 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaceb expref: 54 pid: 6491 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264242.001457:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322789504:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264242.001554:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52d80 going to sleep for 11 seconds 00000100:00080000:3.0:1789264242.003013:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264242.008310:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264242.008420:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311211264 00000100:00100000:3.0:1789264242.008432:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311211264 00010000:00010000:3.0:1789264242.008499:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7793 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaceb expref: 55 pid: 6491 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264242.008547:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 86 00000100:00100000:3.0:1789264242.008560:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+55:2403:x1876179311211264:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264242.008578:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264242.008585:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7793 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaceb expref: 55 pid: 6491 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.008618:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7793 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaceb expref: 55 pid: 6491 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264242.008701:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322789504:192.168.203.44@tcp:104: 00010000:00010000:0.0:1789264242.009085:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.009223:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7793 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaceb expref: 55 pid: 6491 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.009244:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264242.009250:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.009261:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.009270:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.009340:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264242.009420:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+54:2403:x1876179311211264:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 855us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264242.009429:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 86 00010000:00010000:0.0:1789264242.011494:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.011533:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264242.011558:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1789264242.011731:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed77a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacf9 expref: 55 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.011814:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacf9 expref: 54 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.011827:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:0.0:1789264242.011833:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789264242.011836:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1d200, rc 0) 00000100:00100000:0.0:1789264242.011988:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+54:12306:x1876179311211136:12345-192.168.203.44@tcp:101:bash.0 Request processed in 10934us (11970us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789264242.012601:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 174 00000100:00100000:2.0:1789264242.015535:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264242.015623:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311211520 00000100:00100000:3.0:1789264242.015635:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311211520 00000100:00100000:3.0:1789264242.015739:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 175 00000100:00100000:3.0:1789264242.015936:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+54:12306:x1876179311211520:12345-192.168.203.44@tcp:36:bash.0 00010000:00010000:3.0:1789264242.016269:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed77bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.016293:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed77bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.016328:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed77bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789264242.016383:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1789264242.016441:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063bf080f reply state 000000003070c1b8 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed77bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.016458:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed77bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.016467:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264242.016471:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789264242.016476:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789264242.016603:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+57:12306:x1876179311211520:12345-192.168.203.44@tcp:36:bash.0 Request processed in 672us (1080us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789264242.018056:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 175 00000020:00080000:3.0:1789264242.018068:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789264242.023785:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264242.023884:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311211648 00000100:00100000:3.0:1789264242.023898:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311211648 00000100:00100000:3.0:1789264242.023973:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 176 00000100:00100000:3.0:1789264242.023986:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+57:12306:x1876179311211648:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1789264242.024032:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264242.024059:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed77c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad00 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.024406:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed77cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.024438:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacf9 expref: 58 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.024467:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed77cb lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.024510:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacf9 expref: 58 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.024526:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacf9 expref: 58 pid: 6492 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264242.024542:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39845ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876179322789632:192.168.203.44@tcp:104: 00000100:00100000:3.0:1789264242.024650:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab6805600 going to sleep for 11 seconds 00000100:00100000:0.0:1789264242.028649:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264242.028775:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311211776 00000100:00100000:1.0:1789264242.028787:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311211776 00010000:00010000:1.0:1789264242.028836:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacf9 expref: 59 pid: 6492 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264242.028887:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 87 00000100:00100000:1.0:1789264242.028898:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+59:2403:x1876179311211776:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264242.028916:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264242.028924:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacf9 expref: 59 pid: 6492 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.028940:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacf9 expref: 59 pid: 6492 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.028969:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:1.0:1789264242.028994:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed77cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.029007:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed77cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.029085:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed77cb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.029169:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264242.029308:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+59:2403:x1876179311211776:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 411us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264242.029317:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 87 00010000:00010000:3.0:1789264242.029591:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77af lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacf9 expref: 58 pid: 6492 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264242.029611:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39845ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876179322789632:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264242.029647:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed77cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.029656:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed77cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.029662:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed77cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264242.029727:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789264242.029732:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264242.029799:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed77cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.029845:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed77c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad00 expref: 58 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.029861:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed77cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad00 expref: 57 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.029869:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264242.029872:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789264242.029875:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b600, rc 0) 00000100:00100000:3.0:1789264242.029903:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+57:12306:x1876179311211648:12345-192.168.203.44@tcp:101:bash.0 Request processed in 5920us (6166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264242.029910:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 176 00000100:00100000:2.0:1789264242.033821:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264242.033897:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311212032 00000100:00100000:0.0:1789264242.033909:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311212032 00000100:00100000:0.0:1789264242.033979:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:0.0:1789264242.033992:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+57:12306:x1876179311212032:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:0.0:1789264242.034656:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+58:12306:x1876179311212032:12345-192.168.203.44@tcp:35:bash.0 Request processed in 659us (842us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789264242.034667:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:0.0:1789264242.111472:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264242.111601:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311212288 00000100:00100000:2.0:1789264242.111613:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311212288 00000100:00100000:2.0:1789264242.111690:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 177 00000100:00100000:2.0:1789264242.111702:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+58:12316:x1876179311212288:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264242.111733:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264242.111788:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad07 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264242.111947:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789264242.112253:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad07 expref: 60 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.112286:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c398249eb00) 00010000:00010000:2.0:1789264242.112290:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789264242.112296:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed77d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad07 expref: 60 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.112315:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1d200, rc 0) 00000100:00100000:2.0:1789264242.112403:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+59:12316:x1876179311212288:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 703us (944us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1789264242.112420:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 177 00000100:00100000:1.0:1789264242.115708:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264242.115840:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311212416 00000100:00100000:3.0:1789264242.115852:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311212416 00000100:00100000:3.0:1789264242.115938:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 178 00000100:00100000:3.0:1789264242.115951:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+59:12316:x1876179311212416:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:3.0:1789264242.116062:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed77e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116085:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed77e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116105:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed77e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116118:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116151:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116159:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116263:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed77ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116273:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed77ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116281:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed77ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789264242.116342:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed77ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116357:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed77e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116365:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed77e0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116372:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed77e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116380:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264242.116385:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed77e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116393:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed77e0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116425:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:3.0:1789264242.116428:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264242.116434:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed77e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116441:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed77e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116458:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116466:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116472:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116477:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264242.116481:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116487:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116495:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c3983364400) 00010000:00010000:3.0:1789264242.116497:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264242.116501:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116507:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116529:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed77ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116537:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed77ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116543:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed77ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116548:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264242.116552:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed77ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116559:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed77ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116567:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264242.116570:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264242.116573:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed77ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.116580:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed77ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264242.116670:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+59:12316:x1876179311212416:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 721us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264242.116679:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 178 00000100:00100000:1.0:1789264242.119990:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264242.120181:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311212672 00000100:00100000:3.0:1789264242.120251:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311212672 00000100:00100000:3.0:1789264242.120379:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:3.0:1789264242.120421:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+59:12316:x1876179311212672:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:3.0:1789264242.120704:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+60:12316:x1876179311212672:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 297us (727us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789264242.120712:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:2.0:1789264242.157328:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264242.158514:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311212928 00000100:00100000:3.0:1789264242.158531:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311212928 00000100:00100000:3.0:1789264242.158627:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 179 00000100:00100000:3.0:1789264242.158641:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+60:12319:x1876179311212928:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1789264242.158673:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264242.158701:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed77f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad0e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.158852:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77fc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.158871:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.158885:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.158898:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7803 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.158905:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7803 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.158912:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7803 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159080:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed780a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159092:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed780a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159100:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed780a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264242.159112:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789264242.159214:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159222:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77fc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159229:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159235:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264242.159240:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159248:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77fc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159262:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:3.0:1789264242.159265:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264242.159271:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159291:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed77fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159310:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7803 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159317:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7803 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159324:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7803 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159330:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264242.159333:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7803 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159338:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7803 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159346:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c3983364400) 00010000:00010000:3.0:1789264242.159349:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264242.159555:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7803 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.159566:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7803 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.159893:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed77f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad0e expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.159914:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed780a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad0e expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.159922:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:2.0:1789264242.159925:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789264242.159928:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b800, rc 0) 00000100:00100000:2.0:1789264242.160037:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+62:12319:x1876179311212928:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1397us (2721us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789264242.160047:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 179 00000100:00100000:1.0:1789264242.164474:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264242.168934:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311213056 00000100:00100000:3.0:1789264242.168954:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311213056 00000100:00100000:3.0:1789264242.169037:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 180 00000100:00100000:3.0:1789264242.169050:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+62:12319:x1876179311213056:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:3.0:1789264242.169177:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7818 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.169198:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.169214:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.169258:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.169267:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7818 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.169275:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7818 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.169282:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264242.169287:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7818 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264242.169296:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00010000:00010000:3.0:1789264242.169301:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7818 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.169316:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264242.169321:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789264242.169327:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7818 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.169335:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7818 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264242.169446:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+62:12319:x1876179311213056:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 399us (4986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264242.169455:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 180 00000100:00100000:1.0:1789264242.169661:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311213184 00000100:00100000:1.0:1789264242.169666:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311213184 00000100:00100000:1.0:1789264242.169715:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00100000:1.0:1789264242.169724:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+62:2403:x1876179311213184:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264242.169737:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264242.169988:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed780a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad0e expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.170004:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:1.0:1789264242.170007:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264242.170049:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+61:2403:x1876179311213184:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 326us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264242.170056:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00100000:2.0:1789264242.174787:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264242.174897:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311213440 00000100:00100000:1.0:1789264242.174911:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311213440 00000100:00100000:1.0:1789264242.174979:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:1.0:1789264242.174991:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+61:12319:x1876179311213440:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:1.0:1789264242.175644:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+62:12319:x1876179311213440:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 653us (870us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789264242.175654:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:0.0:1789264242.311986:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264242.314048:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311213696 00000100:00100000:1.0:1789264242.314068:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311213696 00000100:00100000:1.0:1789264242.314190:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 181 00000100:00100000:1.0:1789264242.314202:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+62:12337:x1876179311213696:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:1.0:1789264242.314233:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264242.314266:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44000/0xecaf9f2f14ed781f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad15 expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.314405:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7826 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.314432:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7826 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.314444:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7826 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264242.314457:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789264242.314696:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264242.316487:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44000/0xecaf9f2f14ed781f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad15 expref: 65 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.316524:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7826 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad15 expref: 64 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.316550:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:1.0:1789264242.316553:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789264242.316624:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45200, rc 0) 00000100:00100000:1.0:1789264242.316728:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+64:12337:x1876179311213696:12345-192.168.203.44@tcp:101:cat.0 Request processed in 2526us (4753us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1789264242.316737:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 181 00000100:00100000:0.0:1789264242.363218:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264242.363366:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311213824 00000100:00100000:2.0:1789264242.363380:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311213824 00000100:00100000:2.0:1789264242.363482:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 182 00000100:00100000:2.0:1789264242.363496:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+64:12338:x1876179311213824:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264242.363528:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264242.363554:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed7834 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad1c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.363636:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed783b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.363653:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed783b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.363667:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed783b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264242.363720:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789264242.363724:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264242.363782:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed783b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.363814:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed7834 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad1c expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.363835:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed783b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad1c expref: 65 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.363845:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:2.0:1789264242.363849:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789264242.363870:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c200, rc 0) 00000100:00100000:2.0:1789264242.363943:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+65:12338:x1876179311213824:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 450us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264242.363951:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 182 00000100:00100000:2.0:1789264242.373365:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264242.373617:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311214208 00000100:00100000:1.0:1789264242.373630:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311214208 00000100:00100000:1.0:1789264242.373704:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 48 00000100:00100000:1.0:1789264242.373805:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+65:12338:x1876179311214208:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:1.0:1789264242.374151:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+66:12338:x1876179311214208:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 436us (2233us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789264242.374161:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 48 00000100:00100000:0.0:1789264242.383788:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264242.383948:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311214336 00000100:00100000:3.0:1789264242.383961:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311214336 00000100:00100000:3.0:1789264242.384449:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:3.0:1789264242.384464:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+66:12338:x1876179311214336:12345-192.168.203.44@tcp:103:lfs.0 00010000:00010000:3.0:1789264242.384486:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789264242.384519:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed77cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad00 expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.384547:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45200/0xecaf9f2f14ed7826 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad15 expref: 65 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.384561:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed76c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacba expref: 64 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.384573:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264242.384578:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264242.384652:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+63:12338:x1876179311214336:12345-192.168.203.44@tcp:103:lfs.0 Request processed in 192us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264242.384660:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:2.0:1789264242.388579:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264242.388669:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311214464 00000100:00100000:3.0:1789264242.388681:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311214464 00000100:00100000:3.0:1789264242.388818:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 183 00000100:00100000:3.0:1789264242.388841:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+63:12338:x1876179311214464:12345-192.168.203.44@tcp:58:lfs.0 00010000:00010000:3.0:1789264242.389033:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7842 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.389055:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7842 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.389068:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7842 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789264242.389538:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789264242.389662:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+63:12338:x1876179311214464:12345-192.168.203.44@tcp:58:lfs.0 Request processed in 831us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264242.389673:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 183 00000100:00100000:2.0:1789264242.419853:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264242.420148:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311214592 00000100:00100000:1.0:1789264242.420164:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311214592 00000100:00100000:1.0:1789264242.420255:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 184 00000100:00100000:1.0:1789264242.420267:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+63:12340:x1876179311214592:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1789264242.420296:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264242.420324:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7849 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad23 expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420429:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7850 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420451:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7850 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420486:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7850 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420501:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45800/0xecaf9f2f14ed7857 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420510:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45800/0xecaf9f2f14ed7857 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420517:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45800/0xecaf9f2f14ed7857 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420631:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed785e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420641:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed785e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420782:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed785e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264242.420837:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789264242.420842:0:7904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789264242.420867:0:7904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed785e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420880:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed785e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420889:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7850 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420907:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7850 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420915:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7850 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420922:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45c00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264242.420927:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7850 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420935:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7850 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420948:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:1.0:1789264242.420951:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789264242.420956:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7850 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420961:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7850 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.420978:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45800/0xecaf9f2f14ed7857 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.421199:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45800/0xecaf9f2f14ed7857 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.421206:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45800/0xecaf9f2f14ed7857 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.421212:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264242.421222:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45800/0xecaf9f2f14ed7857 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.421229:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45800/0xecaf9f2f14ed7857 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.421240:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c3983364400) 00010000:00010000:1.0:1789264242.421243:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789264242.421246:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45800/0xecaf9f2f14ed7857 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.421251:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45800/0xecaf9f2f14ed7857 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.421291:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7849 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad23 expref: 65 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.421307:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed785e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad23 expref: 64 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.421314:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:1.0:1789264242.421317:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789264242.421320:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45e00, rc 0) 00000100:00100000:1.0:1789264242.421424:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+64:12340:x1876179311214592:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1158us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264242.421433:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 184 00000100:00100000:1.0:1789264242.699102:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322789760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789264242.699199:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322789888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789264242.699246:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264242.699357:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264242.699397:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322789760 00000100:00100000:0.0:1789264242.699416:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322789760 00000100:00100000:3.0:1789264242.699430:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322789888 00000100:00100000:3.0:1789264242.699436:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322789888 00000100:00100000:0.0:1789264242.699488:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789264242.699499:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322789760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789264242.699533:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789264242.699593:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322789760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264242.699770:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322790016:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.699815:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264242.699841:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322790528:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.699867:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264242.699885:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322791040:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.699925:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264242.699949:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789264242.699956:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abacece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322790144:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.699981:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264242.700008:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322790656:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.700031:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264242.700049:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322791168:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.700071:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264242.700134:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322790016 00000100:00100000:2.0:1789264242.700138:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322790016 00000100:00100000:2.0:1789264242.700200:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1789264242.700214:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322790016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.700268:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322790016:12345-0@lo:400:kworker.0 Request processed in 61us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264242.700293:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1789264242.700361:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322790528 00000100:00100000:2.0:1789264242.700366:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322790528 00000100:00100000:2.0:1789264242.700426:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789264242.700434:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322790528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.700486:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322790528:12345-0@lo:400:kworker.0 Request processed in 54us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264242.700493:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789264242.700522:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322791040 00000100:00100000:2.0:1789264242.700533:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322791040 00000100:00100000:2.0:1789264242.700572:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789264242.700585:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaf86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322791040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.700621:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaf86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322791040:12345-0@lo:400:kworker.0 Request processed in 42us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264242.700647:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789264242.700854:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322790144 00000100:00100000:2.0:1789264242.700859:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322790144 00000100:00100000:2.0:1789264242.700885:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322790656 00000100:00100000:2.0:1789264242.700888:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322790656 00000100:00100000:2.0:1789264242.700912:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322791168 00000100:00100000:2.0:1789264242.700916:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322791168 00000100:00100000:2.0:1789264242.700932:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789264242.700941:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322790144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.700983:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322790144:12345-0@lo:400:kworker.0 Request processed in 43us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264242.700995:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789264242.701007:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789264242.701026:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322790656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701062:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322790656:12345-0@lo:400:kworker.0 Request processed in 37us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264242.701068:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789264242.701087:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789264242.701094:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322791168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701128:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1876179322791168:12345-0@lo:400:kworker.0 Request processed in 35us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264242.701133:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789264242.701185:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322790400:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701214:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264242.701234:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322790912:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701278:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264242.701300:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789264242.701307:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322790272:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701331:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264242.701347:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322790784:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701380:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264242.701397:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1876179322791296:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701427:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264242.701452:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322790912 00000100:00100000:2.0:1789264242.701455:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322790912 00000100:00100000:2.0:1789264242.701485:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789264242.701491:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322790912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701526:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322790912:12345-0@lo:400:kworker.0 Request processed in 36us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264242.701539:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789264242.701555:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322790400 00000100:00100000:2.0:1789264242.701559:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322790400 00000100:00100000:2.0:1789264242.701577:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322790784 00000100:00100000:2.0:1789264242.701580:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322790784 00000100:00100000:2.0:1789264242.701594:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322791296 00000100:00100000:2.0:1789264242.701596:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322791296 00000100:00100000:2.0:1789264242.701609:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789264242.701615:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322790400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701645:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322790400:12345-0@lo:400:kworker.0 Request processed in 30us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264242.701651:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789264242.701663:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789264242.701668:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322790784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701693:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322790784:12345-0@lo:400:kworker.0 Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264242.701699:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789264242.701711:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789264242.701717:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876179322791296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701765:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876179322791296:12345-0@lo:400:kworker.0 Request processed in 25us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264242.701772:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789264242.701792:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322790272 00000100:00100000:2.0:1789264242.701796:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322790272 00000100:00100000:2.0:1789264242.701821:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789264242.701828:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322790272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701866:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322790272:12345-0@lo:400:kworker.0 Request processed in 39us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264242.701872:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789264242.701917:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abacece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322790144:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701929:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322790656:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701940:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1876179322791168:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701949:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322790016:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701959:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322790528:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.701970:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322791040:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.702007:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322790272:0@lo:400:kworker.0 00010000:00080000:2.0:1789264242.702020:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ff3b80 x1876179322790784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264242.702030:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322790784:0@lo:400:kworker.0 00010000:00080000:2.0:1789264242.702039:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ff1f80 x1876179322791296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264242.702048:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1876179322791296:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.702059:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322790400:0@lo:400:kworker.0 00000100:00100000:2.0:1789264242.702068:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322790912:0@lo:400:kworker.0 00000100:00080000:2.0:1789264242.702115:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789264242.702120:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789264242.702129:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789264242.702131:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789264242.703547:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789264242.703578:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322789888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789264242.703609:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789264242.703849:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322789760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789264242.703862:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322789888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 300us (4504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264242.703874:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789264242.703927:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322789888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789264242.704655:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000040:00080000:0.0:1789264242.957307:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789264242.957316:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789264242.957355:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1789264242.957363:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789264242.957523:0:13760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fe3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13760:1876179322791424:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789264242.957661:0:13760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc000 going to sleep for 11 seconds 00000100:00100000:0.0:1789264242.962493:0:13760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fe3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13760:1876179322791424:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789264242.964155:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264242.964244:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311214720 00000100:00100000:0.0:1789264242.964251:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311214720 00000100:00100000:0.0:1789264242.964304:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 185 00000100:00100000:0.0:1789264242.964313:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+64:12351:x1876179311214720:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789264242.964343:0:9197:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789264242.964609:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+64:12351:x1876179311214720:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 296us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264242.964618:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 185 00000001:00080000:2.0:1789264242.971216:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:2.0:1789264242.971274:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789264242.971310:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c39825fc300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789264242.971315:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c3983c29200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c39825fc180 00000020:00080000:2.0:1789264242.971319:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c39835b2a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c3983759a00 00000100:00100000:1.0:1789264242.971457:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789264242.971478:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322791552:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789264242.971684:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264242.971731:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322791552 00000100:00100000:2.0:1789264242.971792:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322791552 00000020:00080000:3.0:1789264242.971840:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1789264242.971871:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789264242.971886:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1876179322791552:12345-0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1789264242.971918:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00002000:00080000:2.0:1789264242.971924:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1789264242.971968:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa60170, atime: 0x6aa60171, ctime: 0x6aa60170, blocks: 0x8 00010000:00010000:2.0:1789264242.971977:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7865 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.972109:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=323s v=(0 0) 00010000:00010000:2.0:1789264242.972116:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264242.972124:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.972202:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.972215:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.972249:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.972344:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789264242.972643:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3624:x1876179322791552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 759us (957us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789264242.972652:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000004:00080000:1.0:1789264242.972805:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c3983f4bb80/2, rc 0, transno 4294967308 00000100:00100000:1.0:1789264242.972816:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322791552:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789264242.973126:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264242.973206:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.973218:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1da00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264242.973224:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.973234:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7865 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.973256:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7865 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.973264:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc9af737/0xecaf9f2f14ed7865 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264242.973691:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264242.973804:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311214848 00000100:00100000:3.0:1789264242.973813:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311214848 00000100:00100000:3.0:1789264242.973867:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 186 00000100:00100000:3.0:1789264242.973880:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+22:12351:x1876179311214848:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789264242.973891:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed760b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.973920:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed760b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.973928:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed760b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.973934:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ae00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264242.973939:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed760b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.973948:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed760b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.973962:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed786c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.973969:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c398249ea00) 00010000:00010000:0.0:1789264242.973975:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264242.973980:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed760b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.973981:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed786c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974003:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed760b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.974021:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed786c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974028:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7612 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974041:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7612 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974063:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7612 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974071:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366a000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264242.974082:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7612 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974089:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7612 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974099:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:0.0:1789264242.974102:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264242.974104:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7612 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974109:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a000/0xecaf9f2f14ed7612 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974124:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7651 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974129:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7651 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974134:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7651 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974139:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264242.974141:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7651 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974146:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7651 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974152:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c3983364400) 00010000:00010000:0.0:1789264242.974155:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264242.974163:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7651 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974168:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7651 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974185:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7754 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974191:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7754 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974197:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7754 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974201:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36bc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264242.974204:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7754 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974210:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7754 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974218:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:0.0:1789264242.974220:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264242.974223:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7754 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974229:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7754 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974238:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7777 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974243:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7777 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974255:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7777 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974259:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264242.974262:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7777 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974268:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7777 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974275:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:0.0:1789264242.974278:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264242.974280:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7777 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974285:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7777 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974295:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed77bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974302:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed77bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974308:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed77bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974313:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264242.974316:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed77bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974330:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed77bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974339:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:0.0:1789264242.974341:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264242.974344:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed77bd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264242.974348:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed77bd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264242.975196:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264242.975204:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264242.975208:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264242.975996:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7873 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976018:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7873 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976029:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7873 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976065:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed787a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976074:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed787a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976083:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed787a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264242.976135:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789264242.976140:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264242.976156:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed787a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976169:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed786c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976176:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed786c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976182:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed786c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976205:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264242.976209:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed786c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976216:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed786c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976228:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e7c300) 00010000:00010000:3.0:1789264242.976231:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264242.976234:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed786c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976240:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed786c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976252:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7873 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976258:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7873 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976264:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7873 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976268:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264242.976271:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7873 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976276:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7873 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976295:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9c3983364d00) 00010000:00010000:3.0:1789264242.976297:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264242.976300:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7873 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976306:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7873 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976322:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed787a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976329:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed787a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976335:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed787a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976340:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36aa00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264242.976343:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed787a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976349:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed787a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976356:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264242.976359:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264242.976362:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed787a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264242.976368:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed787a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264242.976485:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+17:12351:x1876179311214848:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 Request processed in 2605us (2796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264242.976496:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 186 00000100:00100000:1.0:1789264242.987869:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264242.987908:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311215104 00000100:00100000:1.0:1789264242.987918:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311215104 00000100:00100000:1.0:1789264242.987972:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 187 00000100:00100000:1.0:1789264242.987982:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+17:12351:x1876179311215104:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789264242.988011:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264242.988033:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7881 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad2a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.988139:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7888 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.988155:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.988165:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264242.988176:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789264242.988255:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.988262:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7888 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.988277:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7888 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.988283:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264242.988287:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7888 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.988295:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7888 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.988307:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:1.0:1789264242.988310:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789264242.988315:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7888 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.988321:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7888 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.988362:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7881 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad2a expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.988373:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e7c300) 00010000:00010000:1.0:1789264242.988375:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789264242.988379:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7881 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad2a expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264242.988390:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44c00, rc 0) 00000100:00100000:1.0:1789264242.988455:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+18:12351:x1876179311215104:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 474us (595us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1789264242.988470:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 187 00000100:00100000:3.0:1789264242.992957:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264242.992994:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311215232 00000100:00100000:3.0:1789264242.993004:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311215232 00000100:00100000:3.0:1789264242.993056:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 188 00000100:00100000:3.0:1789264242.993065:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+18:12351:x1876179311215232:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789264242.993100:0:9197:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789264242.993204:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+18:12351:x1876179311215232:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 139us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264242.993212:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 188 00000100:00100000:2.0:1789264243.003381:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264243.003457:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311215488 00000100:00100000:3.0:1789264243.003467:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311215488 00000100:00100000:3.0:1789264243.003569:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 189 00000100:00100000:3.0:1789264243.003579:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+18:12351:x1876179311215488:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789264243.003598:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264243.003601:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789264243.003627:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed783b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad1c expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.003645:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:3.0:1789264243.003650:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789264243.003663:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7896 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad31 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789264243.004076:0:6491:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789264243.004213:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed789d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.004226:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed789d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.004237:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed789d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.004289:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7896 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad31 expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.004304:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed789d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad31 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.004310:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3983364d00) 00010000:00010000:3.0:1789264243.004312:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789264243.004315:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a000, rc 0) 00000100:00100000:3.0:1789264243.004371:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+19:12351:x1876179311215488:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 793us (999us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789264243.004378:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 189 00000100:00100000:1.0:1789264243.012534:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264243.017714:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311215744 00000100:00100000:3.0:1789264243.017729:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311215744 00000100:00100000:3.0:1789264243.017810:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 190 00000100:00100000:3.0:1789264243.017821:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+19:12351:x1876179311215744:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789264243.017884:0:7904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264243.017917:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed789d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad31 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.017937:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3983364d00) 00010000:00010000:3.0:1789264243.017948:0:7904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789264243.017971:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed78ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.017984:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed78ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.017994:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed78ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018009:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x24412483 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018017:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x24412483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018024:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x24412483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018070:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed78ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018078:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed78ab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018086:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed78ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018093:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264243.018104:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed78ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018112:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed78ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018121:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:3.0:1789264243.018124:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264243.018128:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed78ab lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018135:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed78ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018146:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x24412483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018152:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78b2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x24412483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018158:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x24412483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018163:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264243.018166:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x24412483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018172:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78b2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x24412483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018180:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x24412483 (ffff9c3983364200) 00010000:00010000:3.0:1789264243.018182:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264243.018191:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78b2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x24412483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.018197:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78b2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x24412483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264243.018276:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+18:12351:x1876179311215744:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 457us (5748us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789264243.018284:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 190 00000100:00100000:1.0:1789264243.027539:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264243.028125:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311215872 00000100:00100000:2.0:1789264243.028136:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311215872 00000100:00100000:2.0:1789264243.028196:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 191 00000100:00100000:2.0:1789264243.028207:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+18:12351:x1876179311215872:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789264243.028227:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264243.028251:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed78b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad38 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.028286:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed78c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.028298:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed78c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.028310:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed78c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.028432:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed78b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad38 expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.028450:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed78c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad38 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.028459:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3aa98f2400) 00010000:00010000:2.0:1789264243.028462:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789264243.028465:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1cc00, rc 0) 00000100:00100000:2.0:1789264243.028525:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+19:12351:x1876179311215872:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 320us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264243.028532:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 191 00000100:00100000:3.0:1789264243.033312:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264243.033670:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311216128 00000100:00100000:1.0:1789264243.033688:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311216128 00000100:00100000:1.0:1789264243.033767:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 192 00000100:00100000:1.0:1789264243.033780:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+19:12351:x1876179311216128:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789264243.033856:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed78c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.033885:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed78c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.033898:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed78c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789264243.034114:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789264243.034126:0:6490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323375381392ns, next at 324375378582ns, rc = 0 00000004:00010000:1.0:1789264243.034175:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007642dc9b reply state 0000000040c5c155 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed78c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.034188:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed78c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.034195:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3aa98f2400) 00010000:00010000:1.0:1789264243.034198:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789264243.034201:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789264243.034294:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+21:12351:x1876179311216128:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 517us (1032us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789264243.034309:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 192 00000100:00100000:1.0:1789264243.044718:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264243.044894:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311216256 00000100:00100000:2.0:1789264243.044903:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311216256 00000100:00100000:2.0:1789264243.044963:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 193 00000100:00100000:2.0:1789264243.044974:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+21:12351:x1876179311216256:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789264243.044997:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264243.045017:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed78ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad3f expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.045071:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed78ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad3f expref: 22 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.045086:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed78ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad3f expref: 22 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.045121:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3aa98f2400) 00010000:00010000:2.0:1789264243.045124:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789264243.045128:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c200, rc 0) 00000100:00100000:2.0:1789264243.045188:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+22:12351:x1876179311216256:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 216us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264243.045194:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 193 00000100:00100000:3.0:1789264243.055991:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264243.056073:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311216384 00000100:00100000:2.0:1789264243.056084:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311216384 00000100:00100000:2.0:1789264243.056155:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:2.0:1789264243.056167:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+6:2403:x1876179311216384:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789264243.056454:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2403:x1876179311216384:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 288us (469us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789264243.056463:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00080000:3.0:1789264243.056782:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789264243.061942:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264243.063321:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311216640 00000100:00100000:0.0:1789264243.063333:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311216640 00000100:00100000:1.0:1789264243.063461:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 49 00000100:00100000:1.0:1789264243.063473:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+22:12351:x1876179311216640:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789264243.063685:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+23:12351:x1876179311216640:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 213us (1752us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789264243.063694:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 49 00000100:00100000:1.0:1789264243.069890:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264243.069976:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311216896 00000100:00100000:3.0:1789264243.069986:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311216896 00000100:00100000:3.0:1789264243.070285:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 194 00000100:00100000:3.0:1789264243.070296:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+23:12351:x1876179311216896:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789264243.071202:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+23:12351:x1876179311216896:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 903us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264243.071213:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 194 00000100:00100000:3.0:1789264243.078395:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264243.079896:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311217024 00000100:00100000:1.0:1789264243.079909:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311217024 00000100:00100000:1.0:1789264243.080148:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 195 00000100:00100000:1.0:1789264243.080159:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+23:12351:x1876179311217024:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789264243.080187:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264243.080209:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45800/0xecaf9f2f14ed78d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad46 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.080276:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed78dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.080290:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed78dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.080301:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed78dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264243.080341:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789264243.080357:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed78dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.080390:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45800/0xecaf9f2f14ed78d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad46 expref: 25 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.080418:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed78dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad46 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.080428:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3aa98f2400) 00010000:00010000:1.0:1789264243.080431:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789264243.080434:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44a00, rc 0) 00000100:00100000:1.0:1789264243.080497:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+24:12351:x1876179311217024:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 340us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264243.080504:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 195 00000100:00100000:0.0:1789264243.085473:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264243.085518:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311217152 00000100:00100000:0.0:1789264243.085526:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311217152 00000100:00100000:0.0:1789264243.085576:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:0.0:1789264243.085586:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2402:x1876179311217152:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264243.085604:0:10317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264243.085625:0:10317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3536427/0xecaf9f2f14ed78e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad4d expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789264243.085652:0:10317:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa60173, blocks: 0x0 00010000:00010000:0.0:1789264243.085671:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=323s v=(0 0) 00010000:00010000:0.0:1789264243.085676:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264243.085685:0:10317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3536427/0xecaf9f2f14ed78e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad4d expref: 8 pid: 10317 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.085721:0:10317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a3536427/0xecaf9f2f14ed78e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad4d expref: 8 pid: 10317 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.085735:0:10317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836cb400, rc 0) 00000100:00100000:0.0:1789264243.085814:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311217152:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 229us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264243.085821:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:0.0:1789264243.089418:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264243.089516:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311217408 00000100:00100000:1.0:1789264243.089528:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311217408 00000100:00100000:1.0:1789264243.089591:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 196 00000100:00100000:1.0:1789264243.089604:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+24:12351:x1876179311217408:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789264243.089768:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+24:12351:x1876179311217408:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 167us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264243.089777:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 196 00000100:00100000:0.0:1789264243.094891:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264243.095013:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311217536 00000100:00100000:2.0:1789264243.095024:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311217536 00000100:00100000:2.0:1789264243.095076:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:2.0:1789264243.095087:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+8:12351:x1876179311217536:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789264243.095104:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264243.095123:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc9af737/0xecaf9f2f14ed78ea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad54 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.095156:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3536427/0xecaf9f2f14ed78e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad4d expref: 9 pid: 10317 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.095884:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264243.095889:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264243.095896:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9af737/0xecaf9f2f14ed78ea lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad54 expref: 9 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.095938:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3536427/0xecaf9f2f14ed78e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad4d expref: 9 pid: 10317 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.095953:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3536427/0xecaf9f2f14ed78e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad4d expref: 9 pid: 10317 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264243.095968:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1876179322791680:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264243.096097:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2d36000 going to sleep for 11 seconds 00000100:00100000:1.0:1789264243.102947:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1876179322791680:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264243.102988:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc9af737/0xecaf9f2f14ed78ea lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad54 expref: 9 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.103011:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1da00, rc 0) 00000100:00100000:1.0:1789264243.103074:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+9:12351:x1876179311217536:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 7988us (8191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264243.103093:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:1.0:1789264243.104782:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264243.104895:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311217664 00000100:00100000:0.0:1789264243.104905:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311217664 00010000:00010000:0.0:1789264243.104943:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3536427/0xecaf9f2f14ed78e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad4d expref: 9 pid: 10317 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264243.104981:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 88 00000100:00100000:0.0:1789264243.104991:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2403:x1876179311217664:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264243.105015:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264243.105037:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3536427/0xecaf9f2f14ed78e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad4d expref: 9 pid: 10317 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.105050:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3536427/0xecaf9f2f14ed78e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad4d expref: 9 pid: 10317 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.105074:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3536427/0xecaf9f2f14ed78e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad4d expref: 9 pid: 10317 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.105115:0:7892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264243.105120:0:7892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264243.105129:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc9af737/0xecaf9f2f14ed78ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad54 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.105139:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9af737/0xecaf9f2f14ed78ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad54 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.105186:0:7892:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cc9af737/0xecaf9f2f14ed78ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad54 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264243.105200:0:7892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fe2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1876179322791808:192.168.203.44@tcp:105: 00000100:00100000:0.0:1789264243.105269:0:7892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789264243.110688:0:7892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fe2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1876179322791808:192.168.203.44@tcp:105: 00010000:00010000:2.0:1789264243.110717:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264243.110790:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2403:x1876179311217664:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 5799us (6012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264243.110801:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 88 00000100:00100000:1.0:1789264243.114287:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264243.114369:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311217792 00000100:00100000:3.0:1789264243.114379:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311217792 00002000:00100000:3.0:1789264243.114438:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9c398374c700 x1876179311217792/t0(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:324/0 lens 504/0 e 0 to 0 dl 1789264254 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789264243.114450:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c398374c700 with x1876179311217792 ext(0->8) 00002000:00010000:3.0:1789264243.114456:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c398374c700 00000100:00100000:3.0:1789264243.114490:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:3.0:1789264243.114501:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311217792:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789264243.115489:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+10:2402:x1876179311217792:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 Request processed in 985us (1206us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789264243.115501:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5 00002000:00100000:3.0:1789264243.115509:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9c398374c700 x1876179311217792/t4294967316(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:324/0 lens 504/448 e 0 to 0 dl 1789264254 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789264243.115518:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c398374c700 with x1876179311217792 ext(0->8) 00002000:00010000:3.0:1789264243.115522:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c398374c700 00000100:00100000:3.0:1789264243.117713:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264243.117883:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311217920 00000100:00100000:2.0:1789264243.117893:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311217920 00000100:00100000:2.0:1789264243.117944:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 197 00000100:00100000:2.0:1789264243.117954:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+24:12351:x1876179311217920:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789264243.124336:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1789264243.124361:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789264243.124389:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1789264243.124513:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398374c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322791936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789264243.124540:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+20:12351:x1876179311217920:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 Request processed in 6583us (6831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264243.124551:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 197 00000100:00100000:1.0:1789264243.124572:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789264243.124623:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed78c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.124635:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed78c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.124642:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed78c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.124648:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264243.124653:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed78c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.124660:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed78c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.124676:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3aa98f2400) 00010000:00010000:3.0:1789264243.124679:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789264243.124683:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed78c7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.124700:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed78c7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789264243.124720:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1789264243.124730:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789264243.124820:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322791936 00000100:00100000:1.0:1789264243.124827:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322791936 00000100:00100000:1.0:1789264243.124874:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789264243.124883:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322791936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789264243.125010:0:8403:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789264243.125014:0:8403:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789264243 00002000:00010000:1.0:1789264243.125017:0:8403:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789264243.125019:0:8403:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789264243 -> 1789264243 00002000:00010000:1.0:1789264243.125021:0:8403:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789264243.125067:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322791936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 185us (495us total) trans 4294967317 rc 0/0 00000004:00080000:2.0:1789264243.125221:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c398374c000/2, rc 0, transno 4294967317 00000100:00100000:2.0:1789264243.125229:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398374c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322791936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789264243.126063:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789264243.129528:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264243.129587:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311218048 00000100:00100000:3.0:1789264243.129597:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311218048 00000100:00100000:3.0:1789264243.129649:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:3.0:1789264243.129659:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+10:2404:x1876179311218048:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789264243.133551:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:2.0:1789264243.133562:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000100:00100000:0.0:1789264243.135636:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2404:x1876179311218048:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 Request processed in 5968us (6106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264243.135651:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:3.0:1789264243.148121:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264243.148159:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311218304 00000100:00100000:3.0:1789264243.148168:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311218304 00000100:00100000:3.0:1789264243.148229:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 198 00000100:00100000:3.0:1789264243.148239:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+19:12351:x1876179311218304:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789264243.148301:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264243.148328:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed78dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad46 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.148347:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3aa98f2400) 00010000:00010000:3.0:1789264243.148352:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789264243.148379:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.148391:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.148400:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789264243.148523:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009986019b reply state 00000000c4d4b125 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.148535:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.148542:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3aa98f2400) 00010000:00010000:3.0:1789264243.148544:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789264243.148547:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789264243.148625:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+20:12351:x1876179311218304:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 388us (514us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1789264243.148632:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 198 00000100:00100000:3.0:1789264243.152921:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264243.153027:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311218432 00000100:00100000:0.0:1789264243.153036:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311218432 00000100:00100000:0.0:1789264243.153089:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 65 00000100:00100000:0.0:1789264243.153099:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2403:x1876179311218432:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789264243.153245:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789264243.153249:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789264243 -> 1789264242 00002000:00010000:0.0:1789264243.153251:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789264241 00002000:00010000:0.0:1789264243.153259:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789264243 -> 1789264242 00002000:00010000:0.0:1789264243.153261:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789264243.153314:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2403:x1876179311218432:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 216us (403us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789264243.153322:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 65 00000040:00080000:1.0:1789264243.154071:0:14666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789264243.154078:0:14666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789264243.154119:0:14666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1789264243.154125:0:14666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789264243.155686:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264243.155772:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311218688 00000100:00100000:0.0:1789264243.155780:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311218688 00000100:00100000:0.0:1789264243.155825:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 199 00000100:00100000:0.0:1789264243.155834:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+20:12351:x1876179311218688:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789264243.155895:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.155911:0:7904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed78c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad38 expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.155921:0:7904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.155955:0:7904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed78c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad38 expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.155968:0:7904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed78c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad38 expref: 20 pid: 6492 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264243.155981:0:7904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fe3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7904:1876179322792064:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264243.156059:0:7904:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc300 going to sleep for 11 seconds 00000100:00100000:3.0:1789264243.157513:0:7904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fe3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7904:1876179322792064:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264243.157538:0:7904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264243.158511:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264243.158876:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311218816 00000100:00100000:1.0:1789264243.158885:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311218816 00010000:00010000:1.0:1789264243.158923:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed78c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad38 expref: 21 pid: 6492 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264243.158960:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89 00000100:00100000:1.0:1789264243.158981:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+21:2402:x1876179311218816:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264243.159011:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264243.159019:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed78c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad38 expref: 21 pid: 6492 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.159033:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed78c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad38 expref: 21 pid: 6492 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.159057:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed78c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad38 expref: 21 pid: 6492 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.159071:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3aa98f2400) 00010000:00010000:1.0:1789264243.159075:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.159084:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.159091:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.159122:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789264243.159182:0:7904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264243.159189:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+20:2402:x1876179311218816:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 210us (681us total) trans 0 rc 0/0 00010000:00010000:3.0:1789264243.159196:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264243.159202:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89 00010000:00010000:3.0:1789264243.159238:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.159246:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.159260:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.159267:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cb400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264243.159271:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.159278:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.159288:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3aa98f2400) 00010000:00010000:3.0:1789264243.159292:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789264243.159295:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.159303:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb400/0xecaf9f2f14ed78f8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264243.159353:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+19:12351:x1876179311218688:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 Request processed in 3519us (3673us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789264243.159360:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 199 00000100:00100000:0.0:1789264243.167545:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264243.167590:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311218944 00000100:00100000:1.0:1789264243.167600:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311218944 00000100:00100000:1.0:1789264243.167673:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:1.0:1789264243.167685:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2403:x1876179311218944:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789264243.167733:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003ad8db1b/0xecaf9f2f14ed78ff lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.167772:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc9af737/0xecaf9f2f14ed78ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad54 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.167781:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264243.167786:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789264243.167793:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad8db1b/0xecaf9f2f14ed78ff lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.167830:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc9af737/0xecaf9f2f14ed78ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad54 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.167846:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc9af737/0xecaf9f2f14ed78ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad54 expref: 8 pid: 8405 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264243.167859:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983c61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8403:1876179322792192:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264243.167946:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398265a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789264243.170714:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264243.170811:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311219072 00000100:00100000:2.0:1789264243.170820:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311219072 00010000:00010000:2.0:1789264243.170857:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9af737/0xecaf9f2f14ed78ea lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad54 expref: 9 pid: 8405 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264243.170901:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 90 00000100:00100000:2.0:1789264243.170911:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2403:x1876179311219072:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264243.170926:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264243.170949:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc9af737/0xecaf9f2f14ed78ea lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad54 expref: 9 pid: 8405 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.170962:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc9af737/0xecaf9f2f14ed78ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad54 expref: 9 pid: 8405 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.170988:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789264243.170992:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789264243.171004:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ad8db1b/0xecaf9f2f14ed78ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.171031:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad8db1b/0xecaf9f2f14ed78ff lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.171053:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264243.171116:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2403:x1876179311219072:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 206us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264243.171123:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 90 00010000:00010000:1.0:1789264243.171372:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc9af737/0xecaf9f2f14ed78ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad54 expref: 8 pid: 8405 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264243.171390:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983c61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8403:1876179322792192:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264243.171425:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003ad8db1b/0xecaf9f2f14ed78ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.171449:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003ad8db1b/0xecaf9f2f14ed78ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.171468:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad8db1b/0xecaf9f2f14ed78ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.171492:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003ad8db1b/0xecaf9f2f14ed78ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.171505:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ad8db1b/0xecaf9f2f14ed78ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.171514:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ad8db1b/0xecaf9f2f14ed78ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.171522:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45a00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264243.171526:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad8db1b/0xecaf9f2f14ed78ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.171534:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad8db1b/0xecaf9f2f14ed78ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.171548:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ad8db1b/0xecaf9f2f14ed78ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.171565:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad8db1b/0xecaf9f2f14ed78ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264243.171614:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2403:x1876179311218944:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 Request processed in 3931us (4075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264243.171622:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:1.0:1789264243.180386:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264243.180481:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311219328 00000100:00100000:2.0:1789264243.180491:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311219328 00000100:00100000:2.0:1789264243.180545:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 200 00000100:00100000:2.0:1789264243.180555:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+19:12351:x1876179311219328:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789264243.180634:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.180650:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed774d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacdd expref: 19 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.180660:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.180688:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed774d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacdd expref: 19 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.180701:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed774d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacdd expref: 19 pid: 7904 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264243.180715:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322792320:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264243.180814:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2d36a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789264243.186795:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322792320:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264243.186826:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264243.188061:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264243.188108:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311219456 00000100:00100000:3.0:1789264243.188116:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311219456 00010000:00010000:3.0:1789264243.188156:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed774d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacdd expref: 20 pid: 7904 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264243.188203:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 91 00000100:00100000:3.0:1789264243.188213:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+20:2402:x1876179311219456:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264243.188226:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264243.188233:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed774d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacdd expref: 20 pid: 7904 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.188246:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed774d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacdd expref: 20 pid: 7904 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.188268:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed774d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdacdd expref: 20 pid: 7904 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.188281:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:3.0:1789264243.188285:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.188294:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.188301:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.188322:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264243.188374:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+19:2402:x1876179311219456:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 161us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264243.188382:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 91 00010000:00010000:3.0:1789264243.188427:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.188435:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.188592:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.188605:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed78ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad3f expref: 19 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.188613:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.188643:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed78ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad3f expref: 19 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.188657:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed78ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad3f expref: 19 pid: 9197 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264243.188671:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39845edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322792448:192.168.203.44@tcp:104: 00000100:00100000:3.0:1789264243.189424:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab55ea240 going to sleep for 11 seconds 00000100:00100000:1.0:1789264243.193883:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264243.194102:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311219584 00000100:00100000:0.0:1789264243.194119:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311219584 00010000:00010000:0.0:1789264243.194157:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed78ce lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad3f expref: 20 pid: 9197 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264243.194201:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 92 00000100:00100000:0.0:1789264243.194210:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+20:2402:x1876179311219584:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264243.194224:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264243.194231:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed78ce lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad3f expref: 20 pid: 9197 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.194244:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed78ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad3f expref: 20 pid: 9197 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.194266:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3aa98f2400) 00010000:00010000:0.0:1789264243.194272:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.194281:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.194289:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.194300:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed78ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad3f expref: 20 pid: 9197 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.194305:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264243.194314:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39845edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322792448:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264243.194335:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.194342:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264243.194348:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+19:2402:x1876179311219584:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 140us (473us total) trans 0 rc 0/0 00010000:00010000:2.0:1789264243.194349:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264243.194356:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 92 00000001:00080000:2.0:1789264243.194458:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1789264243.194565:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1789264243.194595:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1789264243.194655:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6492:1876179322792576:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789264243.194696:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264243.194727:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2d36300 going to sleep for 11 seconds 00000100:00100000:0.0:1789264243.194785:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322792576 00000100:00100000:0.0:1789264243.194790:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322792576 00000100:00100000:0.0:1789264243.194870:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789264243.194877:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6492:x1876179322792576:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789264243.194945:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6492:x1876179322792576:12345-0@lo:1000:mdt00_002.0 Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264243.194951:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789264243.195792:0:6492:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1789264243.195799:0:6492:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c398374c000, transno 4294967317 00000100:00100000:2.0:1789264243.195811:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6492:1876179322792576:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789264243.196448:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1789264243.196508:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6492:1876179322792704:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789264243.196552:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264243.196573:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2d36cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264243.196591:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322792704 00000100:00100000:2.0:1789264243.196603:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322792704 00000100:00100000:2.0:1789264243.196651:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789264243.196660:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6492:x1876179322792704:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789264243.196788:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6492:x1876179322792704:12345-0@lo:1000:mdt00_002.0 Request processed in 130us (236us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789264243.196795:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789264243.196830:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6492:1876179322792704:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789264243.196864:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.196874:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.196882:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.196889:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264243.196894:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.196901:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.196915:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3aa98f2400) 00010000:00010000:2.0:1789264243.196918:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789264243.196922:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.196929:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b600/0xecaf9f2f14ed790d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.196961:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7842 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.196968:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7842 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.196974:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7842 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.196978:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264243.196981:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7842 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.196987:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7842 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.198023:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:2.0:1789264243.198030:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789264243.198036:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7842 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.198045:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7842 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.198083:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.198098:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed785e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad23 expref: 22 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.198106:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.198146:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed785e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad23 expref: 22 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.198161:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed785e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad23 expref: 22 pid: 7904 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264243.198175:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322792832:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264243.198434:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab6805c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789264243.200601:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264243.200693:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322792832:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264243.200721:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264243.200928:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311219712 00000100:00100000:0.0:1789264243.200936:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311219712 00010000:00010000:0.0:1789264243.200968:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed785e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad23 expref: 23 pid: 7904 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264243.201017:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 93 00000100:00100000:0.0:1789264243.201026:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+23:2403:x1876179311219712:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264243.201038:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264243.201045:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed785e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad23 expref: 23 pid: 7904 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.201055:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed785e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad23 expref: 23 pid: 7904 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.201081:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed785e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad23 expref: 23 pid: 7904 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.201183:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:0.0:1789264243.201188:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.201197:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.201216:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264243.201236:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264243.201278:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+22:2403:x1876179311219712:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 253us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264243.201284:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 93 00010000:00010000:2.0:1789264243.201600:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201608:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201619:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201625:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201632:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201637:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1dc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264243.201642:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201657:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201667:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:2.0:1789264243.201670:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264243.201673:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201679:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7914 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201690:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201695:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201701:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201706:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1de00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264243.201709:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201714:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201721:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:2.0:1789264243.201723:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789264243.201726:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264243.201764:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7906 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264243.201910:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+21:12351:x1876179311219328:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 21355us (21675us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789264243.201918:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 200 00000020:00080000:2.0:1789264243.201922:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789264243.202072:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789264243.202076:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789264243.202590:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789264243.202600:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789264243.204554:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264243.204634:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311219968 00000100:00100000:1.0:1789264243.204643:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311219968 00000100:00100000:1.0:1789264243.204698:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:1.0:1789264243.204709:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab27a7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+21:12351:x1876179311219968:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789264243.204962:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789264243.204995:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1789264243.205026:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed791b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.205041:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed791b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.205052:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed791b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.205060:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed791b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.205066:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed791b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.205079:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed791b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264243.205275:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789264243.205358:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab27a7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+23:12351:x1876179311219968:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 649us (809us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789264243.205366:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 50 00000020:00080000:1.0:1789264243.205370:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789264243.205651:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264243.205664:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed791b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.205672:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44e00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264243.205676:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed791b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.205683:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed791b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.205697:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3aa98f2400) 00010000:00010000:3.0:1789264243.205699:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789264243.205704:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed791b lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.205709:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed791b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264243.205721:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264243.205722:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264243.205724:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264243.210859:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789264243.210882:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322792960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789264243.210956:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264243.211010:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322792960 00000100:00100000:3.0:1789264243.211017:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322792960 00000100:00100000:3.0:1789264243.211065:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789264243.211073:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322792960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789264243.211104:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789264243.211200:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322792960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264243.211217:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789264243.211264:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322792960:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789264243.338488:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264243.661280:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264243.661325:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264243.661361:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264243.661392:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264243.661455:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264243.661456:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311220608 00000100:00100000:1.0:1789264243.661467:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311220608 00000100:00100000:3.0:1789264243.661483:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311220224 00000100:00100000:3.0:1789264243.661489:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311220224 00000100:00100000:0.0:1789264243.661586:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311220352 00000100:00100000:0.0:1789264243.661590:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311220352 00000100:00100000:0.0:1789264243.661629:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 101 00000100:00100000:0.0:1789264243.661639:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2404:x1876179311220352:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264243.661722:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2404:x1876179311220352:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 83us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264243.661730:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 101 00000100:00080000:0.0:1789264243.661801:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789264243.661806:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789264243.661879:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311220096 00000100:00100000:2.0:1789264243.661884:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311220096 00000100:00100000:2.0:1789264243.661916:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 369 00000100:00100000:2.0:1789264243.661924:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2404:x1876179311220096:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264243.661951:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2404:x1876179311220096:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 29us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264243.661958:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 369 00000100:00100000:3.0:1789264243.662106:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311220480 00000100:00100000:3.0:1789264243.662111:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311220480 00000100:00100000:1.0:1789264243.662921:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 243 00000100:00100000:1.0:1789264243.662937:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311220224:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264243.663128:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 244 00000100:00100000:0.0:1789264243.663138:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311220608:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264243.663291:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311220608:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 154us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264243.663299:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 244 00000100:00100000:0.0:1789264243.663318:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 245 00000100:00100000:0.0:1789264243.663326:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311220480:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264243.663351:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311220480:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 27us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264243.663372:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 245 00000100:00080000:0.0:1789264243.663394:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264243.665347:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311220224:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 2406us (3944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264243.665362:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 243 00010000:00010000:2.0:1789264244.366099:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789264244.909629:0:14717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789264244.909640:0:14717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789264244.909675:0:14717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1789264244.909681:0:14717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789264244.992281:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264244.992365:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311220864 00000100:00100000:3.0:1789264244.992375:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311220864 00000100:00080000:0.0:1789264244.992492:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789264244.992591:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 201 00000100:00100000:3.0:1789264244.992607:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+23:12370:x1876179311220864:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1789264244.992630:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264244.992649:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7922 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad5b expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264244.992775:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7929 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264244.992791:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7929 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264244.992804:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7929 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264244.992815:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789264244.992925:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7922 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad5b expref: 26 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264244.992944:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7929 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad5b expref: 25 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264244.992952:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:3.0:1789264244.992956:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789264244.992958:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a000, rc 0) 00000100:00100000:3.0:1789264244.993021:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+25:12370:x1876179311220864:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 420us (748us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789264244.993027:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 201 00000100:00100000:1.0:1789264244.997602:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264244.998874:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311220992 00000100:00100000:2.0:1789264244.998885:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311220992 00000100:00100000:2.0:1789264244.998974:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 202 00000100:00100000:2.0:1789264244.998983:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+25:12370:x1876179311220992:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:2.0:1789264244.999050:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7937 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999066:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7937 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999077:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7937 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999101:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed793e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999109:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed793e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999116:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed793e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999190:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7945 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999198:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7945 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999205:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7945 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789264244.999248:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7945 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999260:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7937 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999266:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7937 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999273:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7937 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999278:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1d200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264244.999282:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7937 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999297:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7937 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999309:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:2.0:1789264244.999312:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264244.999316:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7937 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999322:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7937 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999336:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed793e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999342:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed793e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999348:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed793e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999353:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264244.999356:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed793e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999363:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed793e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999370:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c3aa98f2d00) 00010000:00010000:2.0:1789264244.999372:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264244.999375:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed793e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999401:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed793e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999420:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7945 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999426:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7945 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999431:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7945 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999446:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264244.999450:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7945 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999455:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7945 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999462:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c3aa98f2100) 00010000:00010000:2.0:1789264244.999465:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264244.999468:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7945 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264244.999473:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7945 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264244.999557:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+25:12370:x1876179311220992:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 573us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264244.999565:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 202 00000100:00100000:0.0:1789264245.054772:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.054807:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311221248 00000100:00100000:0.0:1789264245.054816:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311221248 00000100:00100000:0.0:1789264245.054866:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 203 00000100:00100000:0.0:1789264245.054876:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+25:12373:x1876179311221248:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264245.054896:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264245.054916:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed794c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad62 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.054985:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7953 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055000:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7953 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055011:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7953 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055023:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed795a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055041:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed795a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055049:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed795a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055158:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7961 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055167:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7961 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055174:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7961 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264245.055184:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789264245.055263:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7953 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055271:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7953 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055278:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7953 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055285:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836caa00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264245.055290:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7953 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055298:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7953 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055321:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:0.0:1789264245.055324:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264245.055329:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7953 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055335:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7953 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055346:0:9197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed795a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055352:0:9197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed795a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055357:0:9197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed795a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055362:0:9197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836ca200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264245.055365:0:9197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed795a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055371:0:9197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed795a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055379:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c39824a1c00) 00010000:00010000:0.0:1789264245.055382:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264245.055384:0:9197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed795a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055401:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed795a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055452:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed794c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad62 expref: 28 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055468:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7961 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad62 expref: 27 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.055475:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264245.055478:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789264245.055481:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836cba00, rc 0) 00000100:00100000:0.0:1789264245.055538:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+27:12373:x1876179311221248:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 661us (775us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1789264245.055546:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 203 00000100:00100000:1.0:1789264245.061286:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264245.063978:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311221376 00000100:00100000:2.0:1789264245.063991:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311221376 00000100:00100000:2.0:1789264245.064059:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 204 00000100:00100000:2.0:1789264245.064073:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398374c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+27:12373:x1876179311221376:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:2.0:1789264245.064143:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed796f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.064160:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed796f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.064171:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed796f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.064206:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed796f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.064214:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed796f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.064222:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed796f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.064228:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264245.064233:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed796f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.064241:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed796f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.064254:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:2.0:1789264245.064258:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789264245.064262:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed796f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.064278:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed796f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264245.064357:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398374c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+27:12373:x1876179311221376:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 287us (3074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264245.064365:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 204 00000100:00100000:0.0:1789264245.078201:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264245.078433:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311221632 00000100:00100000:3.0:1789264245.078444:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311221632 00000100:00100000:3.0:1789264245.078503:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:3.0:1789264245.078514:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+27:12373:x1876179311221632:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:3.0:1789264245.078727:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+28:12373:x1876179311221632:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 213us (534us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789264245.078735:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:0.0:1789264245.105539:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264245.105961:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311221888 00000100:00100000:2.0:1789264245.105972:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311221888 00000100:00100000:2.0:1789264245.106035:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 205 00000100:00100000:2.0:1789264245.106046:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+28:11897:x1876179311221888:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1789264245.106071:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264245.106092:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7976 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad69 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.106190:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.106204:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7961 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad62 expref: 29 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.106212:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.106244:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7961 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad62 expref: 29 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.106257:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7961 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad62 expref: 29 pid: 9197 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264245.106289:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322793088:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264245.110486:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab6805900 going to sleep for 11 seconds 00000100:00100000:1.0:1789264245.111465:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.111465:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322793088:192.168.203.44@tcp:104: 00010000:00010000:0.0:1789264245.111491:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264245.111528:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311222016 00000100:00100000:3.0:1789264245.111535:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311222016 00010000:00010000:3.0:1789264245.111577:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7961 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad62 expref: 30 pid: 9197 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264245.111614:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 94 00000100:00100000:3.0:1789264245.111624:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+30:2402:x1876179311222016:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264245.111639:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264245.111660:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7961 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad62 expref: 30 pid: 9197 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.111672:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7961 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad62 expref: 30 pid: 9197 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.111693:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7961 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad62 expref: 30 pid: 9197 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.111708:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:3.0:1789264245.111713:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.111723:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.111730:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.111780:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264245.111890:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+29:2402:x1876179311222016:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 268us (431us total) trans 0 rc 0/0 00010000:00010000:0.0:1789264245.111892:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264245.111898:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 94 00010000:00010000:0.0:1789264245.111900:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264245.111930:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789264245.112051:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed7976 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad69 expref: 30 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.112074:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad69 expref: 29 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.112082:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264245.112085:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789264245.112087:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c000, rc 0) 00000100:00100000:0.0:1789264245.112113:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+29:11897:x1876179311221888:12345-192.168.203.44@tcp:101:bash.0 Request processed in 6070us (6585us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1789264245.112120:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 205 00000100:00100000:1.0:1789264245.114988:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.115056:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311222144 00000100:00100000:0.0:1789264245.115066:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311222144 00000100:00100000:0.0:1789264245.115132:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 206 00000100:00100000:0.0:1789264245.115140:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+29:11897:x1876179311222144:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1789264245.115164:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264245.115184:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed798b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad70 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.115215:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7992 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.115228:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.115238:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.115354:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed798b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad70 expref: 31 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.115376:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7992 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad70 expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.115384:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264245.115387:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789264245.115399:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836ca200, rc 0) 00000100:00100000:0.0:1789264245.115449:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+30:11897:x1876179311222144:12345-192.168.203.44@tcp:101:bash.0 Request processed in 310us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264245.115455:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 206 00000100:00100000:1.0:1789264245.118545:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.118806:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311222400 00000100:00100000:0.0:1789264245.118817:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311222400 00000100:00100000:0.0:1789264245.118920:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 207 00000100:00100000:0.0:1789264245.118931:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+30:11897:x1876179311222400:12345-192.168.203.44@tcp:36:bash.0 00010000:00010000:0.0:1789264245.119160:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7999 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.119176:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7999 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.119188:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7999 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789264245.119231:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1789264245.119254:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002954fa79 reply state 000000004fe581c2 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7999 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.119267:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7999 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.119292:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264245.119295:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789264245.119299:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789264245.119337:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1789264245.119599:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+34:11897:x1876179311222400:12345-192.168.203.44@tcp:36:bash.0 Request processed in 667us (1059us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789264245.119606:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 207 00000020:00080000:0.0:1789264245.119612:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789264245.121995:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.122076:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311222528 00000100:00100000:0.0:1789264245.122086:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311222528 00000100:00100000:0.0:1789264245.122181:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 208 00000100:00100000:0.0:1789264245.122192:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+34:11897:x1876179311222528:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1789264245.122221:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264245.122239:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed79a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad77 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.122291:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed79a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad77 expref: 35 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.122306:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed79a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad77 expref: 35 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.122326:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264245.122329:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789264245.122332:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836cbc00, rc 0) 00000100:00100000:0.0:1789264245.122400:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+35:11897:x1876179311222528:12345-192.168.203.44@tcp:101:bash.0 Request processed in 199us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264245.122429:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 208 00000100:00100000:1.0:1789264245.128679:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264245.128790:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311222656 00000100:00100000:3.0:1789264245.128799:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311222656 00000100:00080000:0.0:1789264245.128859:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789264245.129347:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:3.0:1789264245.129365:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+7:11897:x1876179311222656:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1789264245.129385:0:10317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264245.129419:0:10317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed79a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad7e expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789264245.129464:0:10317:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa60172, atime: 0x6aa60171, ctime: 0x6aa60172, blocks: 0x8 00010000:00010000:3.0:1789264245.129492:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=325s v=(0 0) 00010000:00010000:3.0:1789264245.129498:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264245.129507:0:10317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed79a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad7e expref: 8 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.129526:0:10317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed79a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad7e expref: 8 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.129546:0:10317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36ac00, rc 0) 00000100:00100000:3.0:1789264245.129612:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+8:11897:x1876179311222656:12345-192.168.203.44@tcp:101:bash.0 Request processed in 255us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264245.129619:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:2.0:1789264245.136710:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264245.136809:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311222784 00000100:00100000:3.0:1789264245.136820:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311222784 00002000:00010000:3.0:1789264245.136862:0:8409:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1789264245.136865:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3983ff3800 with x1876179311222784 ext(0->18446744073709551615) 00002000:00010000:3.0:1789264245.136875:0:8409:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c3983ff3800. 00000100:00100000:3.0:1789264245.136897:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:3.0:1789264245.136904:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311222784:12345-192.168.203.44@tcp:10:bash.0 00002000:00010000:3.0:1789264245.137157:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789264245.137161:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789264242 -> 1789264245 00002000:00010000:3.0:1789264245.137165:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789264241 -> 1789264241 00002000:00010000:3.0:1789264245.137167:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789264242 -> 1789264245 00002000:00010000:3.0:1789264245.137183:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1789264245.137249:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2402:x1876179311222784:12345-192.168.203.44@tcp:10:bash.0 Request processed in 343us (546us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789264245.137258:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 6 00002000:00010000:3.0:1789264245.137261:0:8409:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1789264245.137264:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3983ff3800 with x1876179311222784 ext(0->18446744073709551615) 00002000:00010000:3.0:1789264245.137269:0:8409:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c3983ff3800. 00000100:00100000:1.0:1789264245.234095:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264245.234306:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311222912 00000100:00100000:2.0:1789264245.234319:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311222912 00000100:00100000:2.0:1789264245.234385:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 209 00000100:00100000:2.0:1789264245.234407:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+35:12387:x1876179311222912:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:2.0:1789264245.234480:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79ae lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234498:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234512:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234527:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234536:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234542:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234612:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed79bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234622:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed79bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234647:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed79bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789264245.234695:0:7904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed79bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234708:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234714:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234721:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234728:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1ce00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264245.234732:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234739:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234799:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:2.0:1789264245.234802:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264245.234806:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234813:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234826:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234838:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234843:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234849:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264245.234852:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234858:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234866:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c3aa98f2100) 00010000:00010000:2.0:1789264245.234868:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264245.234870:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234876:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234892:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed79bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234898:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed79bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234904:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed79bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234908:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1dc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264245.234917:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed79bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234923:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed79bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234930:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:2.0:1789264245.234932:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264245.234936:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed79bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.234941:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed79bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264245.235024:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+35:12387:x1876179311222912:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 620us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264245.235032:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 209 00000040:00080000:3.0:1789264245.257967:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789264245.257975:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1789264245.257984:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789264245.258005:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322793216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789264245.258076:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789264245.258091:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789264245.258101:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789264245.258294:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322793216 00000100:00100000:1.0:1789264245.258302:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322793216 00000100:00100000:1.0:1789264245.258361:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789264245.258371:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1876179322793216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789264245.258422:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264245.258473:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1876179322793216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264245.258480:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1789264245.258608:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264245.260291:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322793216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789264245.261425:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322793344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789264245.261489:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264245.262434:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322793344 00000100:00100000:3.0:1789264245.262445:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322793344 00000100:00100000:3.0:1789264245.262656:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789264245.262668:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322793344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789264245.262692:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789264245.262705:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264245.262776:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322793344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264245.262784:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789264245.262807:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322793344:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789264245.262860:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264245.262874:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311223168 00000100:00100000:0.0:1789264245.262878:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311223168 00000100:00100000:0.0:1789264245.262922:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 210 00000100:00100000:0.0:1789264245.262929:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abacef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+35:12390:x1876179311223168:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264245.262941:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264245.262961:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed79c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad85 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263031:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed79ca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263047:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed79ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263059:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed79ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263074:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed79d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263115:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed79d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263123:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed79d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263240:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed79d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263255:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed79d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263262:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed79d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264245.263271:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789264245.263349:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed79ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263357:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed79ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263362:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed79ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263368:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cae00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264245.263372:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed79ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263379:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed79ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263413:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:0.0:1789264245.263416:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264245.263421:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed79ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263427:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed79ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263440:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed79d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263446:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed79d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263452:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed79d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263457:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cb800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264245.263459:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed79d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263465:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed79d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263472:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c39824a1c00) 00010000:00010000:0.0:1789264245.263474:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264245.263477:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed79d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263482:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed79d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263536:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed79c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad85 expref: 38 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263549:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed79d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad85 expref: 37 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.263557:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264245.263559:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789264245.263562:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836ca800, rc 0) 00000100:00100000:0.0:1789264245.263618:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abacef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+37:12390:x1876179311223168:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 689us (917us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789264245.263626:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 210 00000100:00100000:3.0:1789264245.265867:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.265917:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311223296 00000100:00100000:0.0:1789264245.265927:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311223296 00000100:00100000:0.0:1789264245.265991:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 211 00000100:00100000:0.0:1789264245.266001:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abaa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+37:12390:x1876179311223296:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:0.0:1789264245.266067:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.266084:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad69 expref: 37 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.266105:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.266139:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad69 expref: 37 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.266178:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad69 expref: 37 pid: 6491 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264245.266191:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322793472:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264245.266266:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264245.269853:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264245.270449:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311223552 00000100:00100000:3.0:1789264245.270461:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311223552 00000100:00100000:3.0:1789264245.270539:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:3.0:1789264245.270550:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+38:6164:x1876179311223552:12345-192.168.203.44@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789264245.270866:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+39:6164:x1876179311223552:12345-192.168.203.44@tcp:35:ldlm_bl.0 Request processed in 317us (1020us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789264245.270890:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:0.0:1789264245.272425:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876179322793472:192.168.203.44@tcp:104: 00010000:00010000:0.0:1789264245.272453:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264245.279780:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264245.281699:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311223680 00000100:00100000:2.0:1789264245.281712:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311223680 00010000:00010000:2.0:1789264245.281832:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad69 expref: 39 pid: 6491 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264245.281868:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 95 00000100:00100000:2.0:1789264245.281880:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2dde050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+39:2402:x1876179311223680:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264245.281897:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264245.282028:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad69 expref: 39 pid: 6491 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.282045:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad69 expref: 39 pid: 6491 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.282088:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed797d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad69 expref: 39 pid: 6491 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.282105:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:2.0:1789264245.282111:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.282121:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.282129:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.282162:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264245.282359:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.282368:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.282419:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.282427:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.282434:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.282440:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836ca000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264245.282444:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.282451:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.282468:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264245.282471:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789264245.282475:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.282482:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed79e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264245.282539:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2dde050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+38:2402:x1876179311223680:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 661us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264245.282548:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 95 00000100:00100000:0.0:1789264245.285049:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abaa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+37:12390:x1876179311223296:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 19037us (19179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264245.285065:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 211 00000100:00100000:2.0:1789264245.287145:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264245.287210:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311223936 00000100:00100000:3.0:1789264245.287229:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311223936 00000100:00100000:3.0:1789264245.287277:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:3.0:1789264245.287288:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+37:12390:x1876179311223936:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:3.0:1789264245.287527:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+38:12390:x1876179311223936:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 241us (388us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789264245.287536:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:1.0:1789264245.358207:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264245.358315:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311224192 00000100:00100000:2.0:1789264245.358326:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311224192 00000100:00100000:2.0:1789264245.358397:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 212 00000100:00100000:2.0:1789264245.358408:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+38:12401:x1876179311224192:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:2.0:1789264245.358428:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264245.358450:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed79ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad8c expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.358523:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.358623:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.358635:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.358650:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.358656:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.358662:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.358802:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7a02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.358813:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7a02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.358820:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7a02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264245.358830:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789264245.359167:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359175:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359181:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359194:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264245.359198:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359206:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359218:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:2.0:1789264245.359221:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264245.359225:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359231:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed79f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359245:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359251:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359257:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359262:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1ce00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264245.359264:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359270:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359286:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c3aa98f2100) 00010000:00010000:2.0:1789264245.359289:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264245.359291:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359296:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ce00/0xecaf9f2f14ed79fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359340:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed79ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad8c expref: 41 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359352:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7a02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad8c expref: 40 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.359361:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:2.0:1789264245.359363:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789264245.359365:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1de00, rc 0) 00000100:00100000:2.0:1789264245.359447:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+40:12401:x1876179311224192:12345-192.168.203.44@tcp:101:cat.0 Request processed in 1041us (1250us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789264245.359454:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 212 00000100:00100000:0.0:1789264245.365324:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264245.365414:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311224448 00000100:00100000:3.0:1789264245.365426:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311224448 00000100:00100000:3.0:1789264245.365536:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:3.0:1789264245.365548:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+40:12401:x1876179311224448:12345-192.168.203.44@tcp:35:cat.0 00000100:00100000:3.0:1789264245.365863:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+41:12401:x1876179311224448:12345-192.168.203.44@tcp:35:cat.0 Request processed in 318us (545us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789264245.365872:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:3.0:1789264245.380345:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.381488:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311224704 00000100:00100000:0.0:1789264245.381501:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311224704 00000100:00100000:0.0:1789264245.381569:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 213 00000100:00100000:0.0:1789264245.381579:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aae23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+41:12402:x1876179311224704:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1789264245.381637:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789264245.381663:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed79a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad77 expref: 41 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.381686:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1de00/0xecaf9f2f14ed7a02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad8c expref: 40 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.381700:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed79d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad85 expref: 39 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.381713:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7992 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad70 expref: 38 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.381897:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264245.381903:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264245.381979:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7a10 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.381992:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7a10 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382001:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7a10 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382015:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7a17 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382022:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7a17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382028:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7a17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382566:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a1e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382576:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382583:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789264245.382832:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1789264245.382843:0:6490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325724097926ns, next at 326724095216ns, rc = 0 00010000:00010000:0.0:1789264245.382895:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7a25 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382905:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7a25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382913:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7a25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382930:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7a25 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382937:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7a25 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382943:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7a25 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382964:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789264245.382981:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382988:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a1e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.382995:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a1e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.383001:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cae00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264245.383004:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264245.383005:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a1e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.383010:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7a25 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.383011:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a1e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.383016:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cac00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264245.383020:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7a25 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.383026:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7a25 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.383027:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264245.383029:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789264245.383033:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a1e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.383040:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a1e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.383044:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:3.0:1789264245.383046:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789264245.383048:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7a25 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.383053:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7a25 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.383055:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7a10 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.383064:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264245.383066:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264245.383067:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264245.383070:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7a10 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.383076:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7a10 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.383081:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836ca000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264245.383084:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7a10 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.383090:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7a10 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.383096:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:0.0:1789264245.383099:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264245.383101:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7a10 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.383106:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7a10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789264245.383126:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000add96240 reply state 00000000c3ae0b63 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7a17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.383137:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7a17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.383144:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c39824a1c00) 00010000:00010000:0.0:1789264245.383146:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789264245.383148:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789264245.384031:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aae23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+39:12402:x1876179311224704:12345-192.168.203.44@tcp:36:rm.0 Request processed in 2446us (3687us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789264245.384041:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 213 00010000:00010000:2.0:1789264245.387678:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264245.426464:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.426569:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311224960 00000100:00100000:0.0:1789264245.426578:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311224960 00000100:00100000:0.0:1789264245.426638:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 214 00000100:00100000:0.0:1789264245.426649:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+39:12408:x1876179311224960:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1789264245.426681:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264245.426701:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7a2c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad93 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.426837:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a33 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.426853:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a33 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.426864:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a33 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.426890:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7a3a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.426898:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7a3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.426904:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7a3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789264245.427222:0:6491:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789264245.427366:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7a41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.427376:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7a41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.427383:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7a41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.427421:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a33 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.427428:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a33 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.427435:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a33 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.427441:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cae00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264245.427445:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a33 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.427463:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a33 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.427475:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:0.0:1789264245.427478:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264245.427482:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a33 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.427487:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a33 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789264245.427501:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cfd1be1 reply state 000000004abd962f transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7a3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.427511:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7a3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.427516:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c39824a1c00) 00010000:00010000:0.0:1789264245.427519:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789264245.427522:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789264245.427548:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7a2c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad93 expref: 42 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.427562:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7a41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad93 expref: 41 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.427569:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1100) 00010000:00010000:0.0:1789264245.427571:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789264245.427573:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836ca800, rc 0) 00000100:00100000:0.0:1789264245.427638:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+42:12408:x1876179311224960:12345-192.168.203.44@tcp:101:bash.0 Request processed in 990us (1182us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789264245.427652:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 214 00000100:00100000:3.0:1789264245.430476:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264245.430574:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311225088 00000100:00100000:2.0:1789264245.430585:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311225088 00000100:00080000:0.0:1789264245.430682:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789264245.430712:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:2.0:1789264245.430722:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2402:x1876179311225088:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1789264245.430740:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264245.430823:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed7a4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdad9a expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789264245.430851:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789264245.430871:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=325s v=(0 0) 00010000:00010000:2.0:1789264245.430876:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264245.430885:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed7a4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad9a expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.431172:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed7a4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad9a expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.431185:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1ce00, rc 0) 00000100:00100000:2.0:1789264245.431307:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2402:x1876179311225088:12345-192.168.203.44@tcp:101:bash.0 Request processed in 587us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264245.431315:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:3.0:1789264245.433382:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.433472:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311225216 00000100:00100000:0.0:1789264245.433481:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311225216 00000100:00100000:0.0:1789264245.433537:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:0.0:1789264245.433547:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+8:12408:x1876179311225216:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1789264245.433562:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264245.433577:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdada1 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.433605:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed7a4f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad9a expref: 9 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.433614:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264245.433618:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264245.433623:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 9 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.433653:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed7a4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad9a expref: 9 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.433668:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed7a4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad9a expref: 9 pid: 8403 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264245.433681:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1876179322793600:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264245.433802:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc7480 going to sleep for 11 seconds 00000100:00100000:1.0:1789264245.435808:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.435839:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1876179322793600:192.168.203.44@tcp:104: 00010000:00010000:0.0:1789264245.435868:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 9 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.435890:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836cbc00, rc 0) 00000100:00100000:3.0:1789264245.435940:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311225344 00000100:00100000:3.0:1789264245.435946:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311225344 00010000:00010000:3.0:1789264245.435983:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed7a4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad9a expref: 10 pid: 8403 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264245.435996:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+10:12408:x1876179311225216:12345-192.168.203.44@tcp:101:bash.0 Request processed in 2451us (2621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264245.436004:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:3.0:1789264245.436017:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 96 00000100:00100000:3.0:1789264245.436026:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2403:x1876179311225344:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264245.436037:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264245.436059:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed7a4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad9a expref: 9 pid: 8403 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.436072:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed7a4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad9a expref: 9 pid: 8403 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.436112:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095574704/0xecaf9f2f14ed7a4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad9a expref: 9 pid: 8403 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.436126:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264245.436130:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264245.436137:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.436147:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.436176:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264245.436190:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983623b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6477:1876179322793728:192.168.203.44@tcp:105: 00000100:00100000:3.0:1789264245.436268:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab55ea240 going to sleep for 11 seconds 00000100:00100000:1.0:1789264245.439583:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983623b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6477:1876179322793728:192.168.203.44@tcp:105: 00010000:00010000:1.0:1789264245.439900:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264245.439966:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2403:x1876179311225344:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 3940us (4163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264245.439977:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 96 00000100:00100000:3.0:1789264245.440127:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264245.440330:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311225600 00000100:00100000:1.0:1789264245.440337:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311225600 00000100:00100000:1.0:1789264245.440397:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:1.0:1789264245.440407:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+42:12408:x1876179311225600:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:1.0:1789264245.440801:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+43:12408:x1876179311225600:12345-192.168.203.44@tcp:35:bash.0 Request processed in 393us (673us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789264245.440808:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 55 00000040:00080000:0.0:1789264245.450814:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789264245.557044:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264245.557163:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311225728 00000100:00100000:1.0:1789264245.557173:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311225728 00000100:00100000:1.0:1789264245.557275:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 215 00000100:00100000:1.0:1789264245.557286:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+43:12424:x1876179311225728:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1789264245.557322:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264245.557342:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7a5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdada8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.557416:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7a64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.557431:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7a64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.557442:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7a64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264245.557495:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789264245.557499:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789264245.557523:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7a64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.557559:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7a5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada8 expref: 45 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.557577:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7a64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada8 expref: 44 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.557585:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:1.0:1789264245.557587:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789264245.557590:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44600, rc 0) 00000100:00100000:1.0:1789264245.557659:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+44:12424:x1876179311225728:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 375us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264245.557666:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 215 00000100:00100000:2.0:1789264245.561070:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.561122:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311225984 00000100:00100000:0.0:1789264245.561132:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311225984 00000100:00100000:0.0:1789264245.561188:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 216 00000100:00100000:0.0:1789264245.561198:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+44:12424:x1876179311225984:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264245.561216:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264245.561237:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7a6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdadaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.561341:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.561355:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.561366:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264245.561377:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789264245.562213:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7a6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadaf expref: 47 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.562236:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadaf expref: 46 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.562245:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1100) 00010000:00010000:0.0:1789264245.562248:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789264245.562252:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836cae00, rc 0) 00000100:00100000:0.0:1789264245.562371:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+46:12424:x1876179311225984:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1174us (1311us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1789264245.562379:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 216 00000100:00100000:2.0:1789264245.565852:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264245.566147:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311226112 00000100:00100000:3.0:1789264245.566158:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311226112 00000100:00100000:3.0:1789264245.566228:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:3.0:1789264245.566240:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+46:2402:x1876179311226112:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264245.566255:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264245.566278:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7a72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadaf expref: 46 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.566315:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1100) 00010000:00010000:3.0:1789264245.566320:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264245.566379:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+45:2402:x1876179311226112:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 142us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264245.566397:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:0.0:1789264245.566479:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264245.566790:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311226368 00000100:00100000:1.0:1789264245.566796:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311226368 00000100:00100000:1.0:1789264245.566836:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 217 00000100:00100000:1.0:1789264245.566843:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+45:12424:x1876179311226368:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1789264245.566863:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264245.566878:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7a80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdadb6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.567073:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7a87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.567087:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7a87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.567098:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7a87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264245.567111:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789264245.567203:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7a80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadb6 expref: 48 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.567219:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7a87 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadb6 expref: 47 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.567227:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1100) 00010000:00010000:1.0:1789264245.567230:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789264245.567233:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44e00, rc 0) 00000100:00100000:1.0:1789264245.567306:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+47:12424:x1876179311226368:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 462us (827us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1789264245.567323:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 217 00000100:00100000:0.0:1789264245.571698:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264245.571797:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311226496 00000100:00100000:3.0:1789264245.571807:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311226496 00000100:00100000:3.0:1789264245.571859:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:3.0:1789264245.571869:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2403:x1876179311226496:12345-192.168.203.44@tcp:1:lfs.0 00010000:00010000:3.0:1789264245.571912:0:10317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed7a95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.571942:0:10317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.571951:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264245.571955:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789264245.571960:0:10317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed7a95 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.572003:0:10317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.572019:0:10317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 8 pid: 8405 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264245.572057:0:10317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983623b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10317:1876179322793856:192.168.203.44@tcp:104: 00000100:00100000:3.0:1789264245.572300:0:10317:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab55ead80 going to sleep for 11 seconds 00000100:00100000:3.0:1789264245.575023:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.575115:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311226624 00000100:00100000:0.0:1789264245.575124:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311226624 00002000:00100000:0.0:1789264245.575341:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9c3983da1c00 x1876179311226624/t0(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:326/0 lens 504/0 e 0 to 0 dl 1789264256 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789264245.575352:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3983da1c00 with x1876179311226624 ext(0->8) 00010000:00010000:0.0:1789264245.575361:0:8411:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 9 pid: 8405 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.575376:0:8411:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 9 pid: 8405 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789264245.575384:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c3983da1c00 00000100:00100000:0.0:1789264245.575427:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:0.0:1789264245.575451:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2403:x1876179311226624:12345-192.168.203.44@tcp:4:lfs.0 00000100:00100000:2.0:1789264245.576332:0:10317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983623b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10317:1876179322793856:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264245.576368:0:10317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed7a95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264245.576401:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+11:2403:x1876179311226624:12345-192.168.203.44@tcp:4:lfs.0 Request processed in 939us (1374us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789264245.576411:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3 00002000:00100000:0.0:1789264245.576421:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9c3983da1c00 x1876179311226624/t4294967309(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:326/0 lens 504/448 e 0 to 0 dl 1789264256 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789264245.576429:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3983da1c00 with x1876179311226624 ext(0->8) 00010000:00010000:0.0:1789264245.576436:0:8411:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 11 pid: 8405 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.576449:0:8411:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 11 pid: 8405 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789264245.576457:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c3983da1c00 00000100:00100000:2.0:1789264245.578483:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.578829:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311226752 00000100:00100000:0.0:1789264245.578838:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311226752 00010000:00010000:0.0:1789264245.578882:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 11 pid: 8405 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264245.578927:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 97 00000100:00100000:0.0:1789264245.578936:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+11:2403:x1876179311226752:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264245.578950:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789264245.578967:0:6476:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789264245.578970:0:6476:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789264245 00002000:00010000:0.0:1789264245.578972:0:6476:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789264245 00002000:00010000:0.0:1789264245.579174:0:6476:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789264245 00002000:00010000:0.0:1789264245.579176:0:6476:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789264245.579183:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 11 pid: 8405 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.579198:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 11 pid: 8405 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.579223:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000963711fd/0xecaf9f2f14ed7a56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada1 expref: 11 pid: 8405 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.579239:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789264245.579243:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789264245.579249:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed7a95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.579259:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed7a95 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.579296:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264245.579352:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+10:2403:x1876179311226752:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 416us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264245.579361:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 97 00010000:00010000:2.0:1789264245.580242:0:10317:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed7a95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.580271:0:10317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed7a95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.580295:0:10317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed7a95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.580302:0:10317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed7a95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.580309:0:10317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed7a95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.580316:0:10317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36aa00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264245.580320:0:10317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed7a95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.580328:0:10317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed7a95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.580344:0:10317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed7a95 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.580352:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed7a95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264245.580480:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2403:x1876179311226496:12345-192.168.203.44@tcp:1:lfs.0 Request processed in 8611us (8789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264245.580489:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:2.0:1789264245.586637:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.591229:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311227008 00000100:00100000:0.0:1789264245.591244:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311227008 00000100:00100000:0.0:1789264245.591582:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:0.0:1789264245.591594:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab27a5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+47:12424:x1876179311227008:12345-192.168.203.44@tcp:35:lfs.0 00000004:00010000:0.0:1789264245.591686:0:6493:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7a87 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadb6 expref: 47 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789264245.592063:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1789264245.592114:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789264245.592422:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1789264245.592460:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.592477:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7a41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad93 expref: 51 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.592486:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.592520:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7a41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad93 expref: 51 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.592536:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7a41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad93 expref: 51 pid: 6491 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264245.592553:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6493:1876179322793984:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264245.592635:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc7480 going to sleep for 11 seconds 00000100:00100000:1.0:1789264245.595843:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264245.595917:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311227136 00000100:00100000:3.0:1789264245.595928:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311227136 00000100:00100000:0.0:1789264245.595960:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6493:1876179322793984:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264245.595976:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7a41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad93 expref: 52 pid: 6491 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.595985:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264245.596023:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 98 00000100:00100000:3.0:1789264245.596036:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+52:2402:x1876179311227136:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264245.596051:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264245.596058:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7a41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad93 expref: 52 pid: 6491 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.596071:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7a41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad93 expref: 52 pid: 6491 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.596100:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7a41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad93 expref: 52 pid: 6491 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.596115:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1100) 00010000:00010000:3.0:1789264245.596121:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.596130:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.596151:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.596189:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264245.596241:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+51:2402:x1876179311227136:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 209us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264245.596249:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 98 00010000:00010000:0.0:1789264245.596431:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.596446:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789264245.596540:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1789264245.596703:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789264245.596919:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1876179322794112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789264245.596969:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264245.597002:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789264245.597046:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322794112 00000100:00100000:3.0:1789264245.597052:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322794112 00000100:00100000:3.0:1789264245.597162:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789264245.597172:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6493:x1876179322794112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789264245.597310:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6493:x1876179322794112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 140us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264245.597318:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789264245.597603:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1876179322794112:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789264245.597722:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1789264245.597800:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39845ec380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1876179322794240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789264245.597833:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264245.597852:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2d36540 going to sleep for 11 seconds 00000100:00100000:3.0:1789264245.597937:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322794240 00000100:00100000:3.0:1789264245.597942:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322794240 00000100:00100000:3.0:1789264245.597978:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789264245.597995:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6493:x1876179322794240:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789264245.598293:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6493:x1876179322794240:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 299us (458us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789264245.598300:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789264245.598357:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39845ec380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1876179322794240:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789264245.598401:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1789264245.598428:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.598437:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.598445:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.598451:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cbc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264245.598454:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.598462:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.598491:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1100) 00010000:00010000:2.0:1789264245.598493:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789264245.598497:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.598504:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7a9c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789264245.598583:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789264245.598632:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789264245.598642:0:6493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325939897368ns, next at 326939895297ns, rc = 0 00000001:00080000:2.0:1789264245.598647:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1789264245.598664:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1100) 00010000:00010000:2.0:1789264245.598667:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789264245.598672:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7a87 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadb6 expref: 55 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264245.598855:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab27a5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+54:12424:x1876179311227008:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 7264us (12227us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789264245.598864:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 56 00000020:00080000:2.0:1789264245.598867:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789264245.601306:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.601356:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311227264 00000100:00100000:0.0:1789264245.601364:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311227264 00000100:00100000:0.0:1789264245.601422:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 218 00000100:00100000:0.0:1789264245.601432:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+54:12424:x1876179311227264:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264245.601453:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264245.601473:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7aa3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdadbd expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.601529:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadbd expref: 55 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.601544:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadbd expref: 55 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.601562:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:0.0:1789264245.601564:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789264245.601567:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836ca000, rc 0) 00000100:00100000:0.0:1789264245.601687:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+55:12424:x1876179311227264:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 255us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264245.601709:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 218 00000100:00100000:2.0:1789264245.604083:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264245.604524:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311227520 00000100:00100000:1.0:1789264245.604534:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311227520 00000100:00100000:1.0:1789264245.604595:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:1.0:1789264245.604605:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+55:12424:x1876179311227520:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:1.0:1789264245.605225:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+56:12424:x1876179311227520:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 618us (1148us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789264245.605233:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:1.0:1789264245.674460:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.674563:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311227648 00000100:00100000:0.0:1789264245.674573:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311227648 00000100:00100000:0.0:1789264245.674680:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 219 00000100:00100000:0.0:1789264245.674691:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+56:12435:x1876179311227648:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:0.0:1789264245.674799:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7aaa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.674816:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7aaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.674831:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7aaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.674843:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ab1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.674851:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.674858:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675071:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7ab8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675080:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675087:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789264245.675334:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675351:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7aaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675358:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7aaa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675366:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7aaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675372:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cbc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264245.675376:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7aaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675395:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7aaa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675409:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:0.0:1789264245.675412:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264245.675416:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7aaa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675423:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7aaa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675437:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675444:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675456:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675461:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836ca800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264245.675465:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675471:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675479:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c39824a1c00) 00010000:00010000:0.0:1789264245.675481:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264245.675484:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ab1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675490:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ab1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675500:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675506:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7ab8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675512:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675517:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cae00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264245.675519:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675533:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675541:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:0.0:1789264245.675543:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264245.675546:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7ab8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.675552:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cae00/0xecaf9f2f14ed7ab8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264245.675635:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+56:12435:x1876179311227648:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 945us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264245.675644:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 219 00000100:00100000:3.0:1789264245.727090:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264245.727203:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311227904 00000100:00100000:1.0:1789264245.727219:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311227904 00000100:00100000:1.0:1789264245.727296:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 220 00000100:00100000:1.0:1789264245.727306:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+56:12438:x1876179311227904:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1789264245.727325:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264245.727347:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed7abf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdadc4 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727430:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7ac6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727443:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7ac6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727454:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7ac6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727484:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7acd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727492:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7acd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727499:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7acd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727620:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7ad4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727629:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727636:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264245.727645:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789264245.727716:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7ac6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727724:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7ac6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727730:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7ac6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727735:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264245.727739:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7ac6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727806:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7ac6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727819:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:1.0:1789264245.727822:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789264245.727827:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7ac6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727832:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7ac6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727845:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7acd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727851:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7acd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727856:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7acd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727861:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45a00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264245.727864:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7acd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727870:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7acd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727876:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c39824a1c00) 00010000:00010000:1.0:1789264245.727878:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789264245.727881:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7acd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727896:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7acd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727943:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed7abf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadc4 expref: 59 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727956:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadc4 expref: 58 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.727973:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:1.0:1789264245.727975:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789264245.727979:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45000, rc 0) 00000100:00100000:1.0:1789264245.728039:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+58:12438:x1876179311227904:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 735us (968us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789264245.728047:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 220 00000100:00100000:2.0:1789264245.732433:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.732539:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311228032 00000100:00100000:0.0:1789264245.732549:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311228032 00000100:00100000:0.0:1789264245.732611:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 221 00000100:00100000:0.0:1789264245.732620:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+58:12438:x1876179311228032:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:0.0:1789264245.732687:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ae2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.732703:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.732719:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.732791:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.732813:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ae2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.732819:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.732826:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836ca800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264245.732831:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.732837:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.732848:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:0.0:1789264245.732851:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789264245.732855:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ae2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.732861:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ae2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264245.732935:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+58:12438:x1876179311228032:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 316us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264245.732943:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 221 00000100:00100000:0.0:1789264245.740346:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264245.740455:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311228288 00000100:00100000:2.0:1789264245.740465:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311228288 00000100:00100000:2.0:1789264245.740521:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:2.0:1789264245.740530:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+58:12438:x1876179311228288:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:2.0:1789264245.740830:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+59:12438:x1876179311228288:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 301us (493us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1789264245.740838:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:1.0:1789264245.772439:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789264245.772509:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322794368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789264245.772600:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264245.772857:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322794368 00000100:00100000:0.0:1789264245.772867:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322794368 00000100:00100000:0.0:1789264245.773069:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789264245.773082:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322794368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789264245.773156:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789264245.773267:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322794368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 188us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264245.773275:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789264245.777043:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322794368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789264245.822358:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.822443:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311228544 00000100:00100000:0.0:1789264245.822453:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311228544 00000100:00100000:0.0:1789264245.822522:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 222 00000100:00100000:0.0:1789264245.822548:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+59:12448:x1876179311228544:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1789264245.822573:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264245.822577:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789264245.822608:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed7a64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdada8 expref: 59 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.822630:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:0.0:1789264245.822647:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264245.822661:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ae9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdadcb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.822821:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.822836:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadc4 expref: 59 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.822855:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.822887:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadc4 expref: 59 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.822925:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadc4 expref: 59 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264245.822940:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876179322794496:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264245.823047:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264245.826380:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.826559:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876179322794496:192.168.203.44@tcp:104: 00010000:00010000:0.0:1789264245.826597:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264245.826692:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311228672 00000100:00100000:2.0:1789264245.826702:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311228672 00010000:00010000:2.0:1789264245.826801:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadc4 expref: 60 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264245.826844:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 99 00000100:00100000:2.0:1789264245.826857:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+60:2402:x1876179311228672:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264245.826879:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264245.826886:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadc4 expref: 60 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.826899:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadc4 expref: 60 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.826937:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45000/0xecaf9f2f14ed7ad4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadc4 expref: 60 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.826956:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:2.0:1789264245.826961:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.826972:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.827010:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.827040:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264245.827960:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+59:2402:x1876179311228672:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 1096us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264245.827972:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 99 00010000:00010000:0.0:1789264245.828077:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.828088:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264245.828113:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789264245.828293:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7ae9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadcb expref: 60 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.828314:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadcb expref: 59 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.828323:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:0.0:1789264245.828327:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789264245.828330:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836cbc00, rc 0) 00000100:00100000:0.0:1789264245.828376:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+59:12448:x1876179311228544:12345-192.168.203.44@tcp:101:bash.0 Request processed in 5844us (6026us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789264245.828412:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 222 00000100:00100000:2.0:1789264245.839375:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264245.839556:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311228800 00000100:00100000:3.0:1789264245.839566:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311228800 00000100:00100000:3.0:1789264245.839640:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 223 00000100:00100000:3.0:1789264245.839654:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+59:12448:x1876179311228800:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1789264245.839692:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264245.839713:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7afe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdadd2 expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.839788:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7b05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.839802:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7b05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.839814:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7b05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.839926:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7afe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd2 expref: 61 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.839946:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7b05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd2 expref: 60 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.839955:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:3.0:1789264245.839958:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789264245.839961:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36bc00, rc 0) 00000100:00100000:3.0:1789264245.840021:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+60:12448:x1876179311228800:12345-192.168.203.44@tcp:101:bash.0 Request processed in 372us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264245.840028:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 223 00000100:00100000:2.0:1789264245.848461:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264245.848556:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311229056 00000100:00100000:3.0:1789264245.848566:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311229056 00000100:00100000:3.0:1789264245.848640:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 224 00000100:00100000:3.0:1789264245.848651:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+60:12448:x1876179311229056:12345-192.168.203.44@tcp:36:bash.0 00010000:00010000:3.0:1789264245.848953:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7b0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.848969:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7b0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.848980:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7b0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789264245.849022:0:9197:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1789264245.849045:0:9197:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003aacc9f8 reply state 000000002350237a transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7b0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.849057:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7b0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.849064:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:3.0:1789264245.849067:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789264245.849070:0:9197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789264245.849169:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+63:12448:x1876179311229056:12345-192.168.203.44@tcp:36:bash.0 Request processed in 519us (717us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789264245.849176:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 224 00000020:00080000:3.0:1789264245.849181:0:9197:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789264245.858351:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.858491:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311229184 00000100:00100000:0.0:1789264245.858501:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311229184 00000100:00100000:0.0:1789264245.858617:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 225 00000100:00100000:0.0:1789264245.858627:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+63:12448:x1876179311229184:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1789264245.858649:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264245.858681:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7b13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdadd9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.859068:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.859084:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadcb expref: 64 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.859092:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.859127:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadcb expref: 64 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.859142:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadcb expref: 64 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264245.859155:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876179322794624:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264245.859297:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264245.861532:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876179322794624:192.168.203.44@tcp:104: 00010000:00010000:0.0:1789264245.861576:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264245.862335:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.862459:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311229312 00000100:00100000:0.0:1789264245.862465:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311229312 00010000:00010000:0.0:1789264245.862494:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadcb expref: 65 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264245.862521:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 100 00000100:00100000:0.0:1789264245.862527:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+65:2402:x1876179311229312:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264245.862537:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264245.862542:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadcb expref: 65 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.862551:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadcb expref: 65 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.862567:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7af0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadcb expref: 65 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.862578:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:0.0:1789264245.862581:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.862587:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.862592:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.862625:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264245.862699:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+64:2402:x1876179311229312:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 171us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264245.862704:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 100 00010000:00010000:1.0:1789264245.862772:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.862780:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264245.862840:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789264245.862846:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789264245.862879:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.862906:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca800/0xecaf9f2f14ed7b13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd9 expref: 64 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.862922:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd9 expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.862929:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:1.0:1789264245.862932:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789264245.862934:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836ca400, rc 0) 00000100:00100000:1.0:1789264245.862960:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+63:12448:x1876179311229184:12345-192.168.203.44@tcp:101:bash.0 Request processed in 4336us (4620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264245.862967:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 225 00000100:00100000:2.0:1789264245.871064:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.871133:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311229568 00000100:00100000:0.0:1789264245.871144:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311229568 00000100:00100000:0.0:1789264245.871265:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:0.0:1789264245.871279:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+63:12448:x1876179311229568:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:0.0:1789264245.871525:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+64:12448:x1876179311229568:12345-192.168.203.44@tcp:35:bash.0 Request processed in 248us (476us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1789264245.871533:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:2.0:1789264245.945553:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264245.945784:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311229696 00000100:00100000:3.0:1789264245.945794:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311229696 00000100:00100000:3.0:1789264245.945862:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 226 00000100:00100000:3.0:1789264245.945872:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+64:12454:x1876179311229696:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1789264245.945895:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264245.945916:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7b21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdade0 expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.946001:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7b28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.946016:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7b28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.946028:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7b28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264245.946070:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789264245.946074:0:7904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264245.946093:0:7904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7b28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.946118:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7b21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdade0 expref: 66 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.946136:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7b28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdade0 expref: 65 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.946145:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:3.0:1789264245.946149:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789264245.946166:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b800, rc 0) 00000100:00100000:3.0:1789264245.946228:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+65:12454:x1876179311229696:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 357us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264245.946236:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 226 00000100:00100000:2.0:1789264245.948995:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.949067:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311229824 00000100:00100000:0.0:1789264245.949078:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311229824 00000100:00100000:0.0:1789264245.949187:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 227 00000100:00100000:0.0:1789264245.949198:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+65:12454:x1876179311229824:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264245.949219:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264245.949238:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7b2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdade7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949312:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7b36 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949331:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7b36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949342:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7b36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949367:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949376:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949394:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949465:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7b44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949475:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949482:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264245.949521:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789264245.949525:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789264245.949544:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949556:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949564:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7b36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949571:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7b36 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949588:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7b36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949594:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264245.949597:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7b36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949605:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7b36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949618:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:0.0:1789264245.949621:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264245.949625:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7b36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949631:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7b36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949645:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949651:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949656:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949661:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cbe00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264245.949663:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949680:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949688:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c39824a1c00) 00010000:00010000:0.0:1789264245.949691:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264245.949694:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949699:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949726:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbc00/0xecaf9f2f14ed7b2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdade7 expref: 67 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949740:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7b44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdade7 expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.949787:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:0.0:1789264245.949789:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789264245.949792:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836cba00, rc 0) 00000100:00100000:0.0:1789264245.949844:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+66:12454:x1876179311229824:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 649us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264245.949852:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 227 00000100:00100000:2.0:1789264245.956570:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264245.956733:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264245.956980:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311230080 00000100:00100000:1.0:1789264245.956990:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311230080 00000100:00100000:1.0:1789264245.957052:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 228 00000100:00100000:1.0:1789264245.957061:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+66:12454:x1876179311230080:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1789264245.957079:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264245.957107:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed7b4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdadee expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.957210:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.957223:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd9 expref: 67 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.957250:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7b44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdade7 expref: 67 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.957258:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.957289:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7b44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdade7 expref: 67 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.957302:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7b44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdade7 expref: 67 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264245.957314:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876179322794752:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264245.957433:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd9 expref: 67 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.957443:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd9 expref: 67 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264245.957452:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876179322794880:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264245.957475:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a1180 going to sleep for 11 seconds 00000100:00100000:3.0:1789264245.958955:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311230208 00000100:00100000:3.0:1789264245.958967:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311230208 00010000:00010000:3.0:1789264245.959022:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7b44 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdade7 expref: 68 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264245.959067:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 101 00000100:00100000:3.0:1789264245.959077:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+68:2403:x1876179311230208:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264245.959088:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264245.959095:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7b44 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdade7 expref: 68 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.959108:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7b44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdade7 expref: 68 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.959129:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:3.0:1789264245.959134:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.959142:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.959148:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264245.959199:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+68:2403:x1876179311230208:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 124us (2466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264245.959207:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 101 00010000:00010000:1.0:1789264245.961588:0:6490:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.44@tcp) returned -22 from blocking AST (req@000000005e3dc412 x1876179322794752) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7b44 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdade7 expref: 67 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.961613:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cba00/0xecaf9f2f14ed7b44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdade7 expref: 67 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264245.961648:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876179322794752:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264245.961663:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876179322794880:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264245.961683:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:1.0:1789264245.961689:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.961697:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.961707:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264245.963607:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264245.963848:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311230336 00000100:00100000:2.0:1789264245.963857:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311230336 00010000:00010000:2.0:1789264245.963896:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd9 expref: 67 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264245.963940:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 102 00000100:00100000:2.0:1789264245.963951:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+67:2402:x1876179311230336:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264245.963965:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264245.963972:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd9 expref: 67 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.964004:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd9 expref: 67 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.964027:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca400/0xecaf9f2f14ed7b1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd9 expref: 67 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.964044:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:2.0:1789264245.964049:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.964058:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.964065:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264245.964252:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264245.964318:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+66:2402:x1876179311230336:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 369us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264245.964325:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 102 00010000:00010000:1.0:1789264245.965450:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.965463:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264245.965483:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789264245.965672:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed7b4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadee expref: 67 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.965691:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadee expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264245.965699:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:1.0:1789264245.965703:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789264245.965718:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45a00, rc 0) 00000100:00100000:1.0:1789264245.965808:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+66:12454:x1876179311230080:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 8745us (9245us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1789264245.965817:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 228 00000100:00100000:3.0:1789264245.970102:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.970169:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311230592 00000100:00100000:0.0:1789264245.970179:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311230592 00000100:00100000:0.0:1789264245.970243:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:0.0:1789264245.970253:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+66:12454:x1876179311230592:12345-192.168.203.44@tcp:103:lfs.0 00010000:00010000:0.0:1789264245.970282:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264245.970307:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca000/0xecaf9f2f14ed7aa3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadbd expref: 66 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.970326:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:0.0:1789264245.970330:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264245.970397:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+65:12454:x1876179311230592:12345-192.168.203.44@tcp:103:lfs.0 Request processed in 146us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264245.970405:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:0.0:1789264245.973026:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264245.973134:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311230720 00000100:00100000:3.0:1789264245.973144:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311230720 00000100:00100000:3.0:1789264245.973201:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 229 00000100:00100000:3.0:1789264245.973211:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+65:12454:x1876179311230720:12345-192.168.203.44@tcp:58:lfs.0 00010000:00010000:3.0:1789264245.973335:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7b60 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.973353:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7b60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264245.973364:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7b60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789264245.973480:0:9197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789264245.973567:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+65:12454:x1876179311230720:12345-192.168.203.44@tcp:58:lfs.0 Request processed in 356us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264245.973574:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 229 00000100:00100000:2.0:1789264245.981828:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264245.982056:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311230848 00000100:00100000:0.0:1789264245.982065:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311230848 00000100:00100000:0.0:1789264245.982136:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 230 00000100:00100000:0.0:1789264245.982147:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+65:12454:x1876179311230848:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264245.982171:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264245.982192:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdadf5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.982248:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7b60 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.982259:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b67 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadf5 expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.982279:0:6491:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7b60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.982291:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b67 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadf5 expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.982319:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:0.0:1789264245.982322:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789264245.982327:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b67 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadf5 expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264245.982334:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836cbe00, rc 0) 00000100:00100000:0.0:1789264245.982404:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+66:12454:x1876179311230848:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 258us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264245.982412:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 230 00000040:00080000:3.0:1789264246.281949:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789264246.281957:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789264246.282000:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789264246.282009:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789264246.282146:0:13760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3ab301c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13760:1876179322795008:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789264246.282258:0:13760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789264246.286099:0:13760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3ab301c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13760:1876179322795008:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789264246.296817:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264246.297285:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311230976 00000100:00100000:1.0:1789264246.297296:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311230976 00000100:00100000:1.0:1789264246.297375:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 231 00000100:00100000:1.0:1789264246.297395:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+66:12455:x1876179311230976:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789264246.297424:0:6490:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789264246.297523:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+66:12455:x1876179311230976:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 140us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264246.297531:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 231 00000100:00080000:0.0:1789264246.297775:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264246.308704:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264246.310146:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311231104 00000100:00100000:1.0:1789264246.310295:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311231104 00000100:00100000:1.0:1789264246.310429:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 232 00000100:00100000:1.0:1789264246.310441:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+66:12455:x1876179311231104:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789264246.310515:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b6e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.310533:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.310545:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.310560:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7b75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.310567:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7b75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.310589:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7b75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.310611:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7b7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.310620:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7b7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.310627:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7b7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264246.310669:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789264246.310674:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789264246.310686:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7b7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.311606:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.311617:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b6e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.311625:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.311632:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264246.311636:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.311643:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b6e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.311681:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e7c300) 00010000:00010000:1.0:1789264246.311684:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789264246.311690:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b6e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.311695:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b6e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.311710:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7b75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.311716:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7b75 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.311722:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7b75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.311726:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44e00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264246.311729:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7b75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.311734:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7b75 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.313215:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9c3ab7dcac00) 00010000:00010000:1.0:1789264246.313225:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789264246.313234:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7b75 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.313243:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7b75 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.313286:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7b7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.313292:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7b7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.313298:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7b7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.313304:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44a00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264246.313307:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7b7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.313314:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7b7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.313327:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:1.0:1789264246.313330:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789264246.313332:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7b7c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.313338:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7b7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264246.313452:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+66:12455:x1876179311231104:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 Request processed in 3009us (4751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264246.313462:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 232 00000100:00100000:1.0:1789264246.316498:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264246.316587:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311231360 00000100:00100000:2.0:1789264246.316598:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311231360 00000100:00100000:2.0:1789264246.316655:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 233 00000100:00100000:2.0:1789264246.316665:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+66:12455:x1876179311231360:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789264246.316684:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264246.316717:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7b83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdadfc expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.316845:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7b8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.316859:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7b8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.316870:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7b8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264246.316881:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789264246.316954:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7b8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.316963:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7b8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.316969:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7b8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.316975:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1d200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264246.316979:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7b8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.316987:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7b8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.316998:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:2.0:1789264246.317001:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789264246.317005:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7b8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.317022:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7b8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.317135:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7b83 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadfc expref: 68 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.317145:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e7c300) 00010000:00010000:2.0:1789264246.317147:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789264246.317218:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7b83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadfc expref: 68 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.317229:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1dc00, rc 0) 00000100:00100000:2.0:1789264246.317347:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+67:12455:x1876179311231360:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 683us (858us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1789264246.317355:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 233 00000100:00100000:1.0:1789264246.320377:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264246.320462:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311231488 00000100:00100000:2.0:1789264246.320471:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311231488 00000100:00100000:2.0:1789264246.320530:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 234 00000100:00100000:2.0:1789264246.320540:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+67:12455:x1876179311231488:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789264246.320591:0:9197:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789264246.320709:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+67:12455:x1876179311231488:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 171us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264246.320717:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 234 00000100:00100000:3.0:1789264246.329934:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264246.330192:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311231744 00000100:00100000:1.0:1789264246.330216:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311231744 00000100:00100000:1.0:1789264246.330287:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 235 00000100:00100000:1.0:1789264246.330297:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+67:12455:x1876179311231744:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789264246.330316:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264246.330319:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789264246.330345:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7b28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdade0 expref: 67 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.330365:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:1.0:1789264246.330370:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789264246.330394:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7b98 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae03 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789264246.331492:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1789264246.331673:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.331689:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.331700:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.331773:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44e00/0xecaf9f2f14ed7b98 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae03 expref: 69 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.331790:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae03 expref: 68 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.331814:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c3ab7dcac00) 00010000:00010000:1.0:1789264246.331817:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789264246.331820:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45600, rc 0) 00000100:00100000:1.0:1789264246.331885:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+68:12455:x1876179311231744:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1588us (1961us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789264246.331893:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 235 00000100:00100000:1.0:1789264246.337293:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264246.337393:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311232000 00000100:00100000:0.0:1789264246.337402:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311232000 00000100:00100000:0.0:1789264246.337466:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 236 00000100:00100000:0.0:1789264246.337477:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+68:12455:x1876179311232000:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789264246.337533:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264246.337560:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45600/0xecaf9f2f14ed7b9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae03 expref: 68 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337578:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c3ab7dcac00) 00010000:00010000:0.0:1789264246.337589:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264246.337611:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7bad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337625:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7bad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337652:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7bad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337713:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb000/0xecaf9f2f14ed7bb4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x81d40f26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337721:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb000/0xecaf9f2f14ed7bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x81d40f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337728:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb000/0xecaf9f2f14ed7bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x81d40f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337801:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7bad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337809:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7bad lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337815:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7bad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337821:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264246.337825:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7bad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337831:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7bad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337839:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:0.0:1789264246.337841:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264246.337844:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7bad lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337857:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cac00/0xecaf9f2f14ed7bad lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337867:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb000/0xecaf9f2f14ed7bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x81d40f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337873:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb000/0xecaf9f2f14ed7bb4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x81d40f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337879:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb000/0xecaf9f2f14ed7bb4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x81d40f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337885:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cb000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264246.337887:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb000/0xecaf9f2f14ed7bb4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x81d40f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337893:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb000/0xecaf9f2f14ed7bb4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x81d40f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337900:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x81d40f26 (ffff9c39824a1a00) 00010000:00010000:0.0:1789264246.337902:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264246.337905:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb000/0xecaf9f2f14ed7bb4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x81d40f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.337910:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb000/0xecaf9f2f14ed7bb4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x81d40f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264246.338173:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+67:12455:x1876179311232000:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 697us (890us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789264246.338181:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 236 00000100:00100000:3.0:1789264246.343082:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264246.343196:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311232128 00000100:00100000:0.0:1789264246.343205:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311232128 00000100:00100000:0.0:1789264246.343261:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 237 00000100:00100000:0.0:1789264246.343271:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398364df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+67:12455:x1876179311232128:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264246.343291:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264246.343311:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb600/0xecaf9f2f14ed7bbb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae0a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.343345:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed7bc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.343357:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed7bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.343368:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed7bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.343484:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb600/0xecaf9f2f14ed7bbb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae0a expref: 69 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.343502:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed7bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae0a expref: 68 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.343511:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c39824a1400) 00010000:00010000:0.0:1789264246.343514:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789264246.343517:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836cb200, rc 0) 00000100:00100000:0.0:1789264246.343581:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398364df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+68:12455:x1876179311232128:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 312us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264246.343589:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 237 00000100:00100000:3.0:1789264246.346719:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264246.346873:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311232384 00000100:00100000:1.0:1789264246.346883:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311232384 00000100:00100000:1.0:1789264246.346941:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 238 00000100:00100000:1.0:1789264246.346951:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+68:12455:x1876179311232384:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789264246.347067:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7bc9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.347082:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.347094:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789264246.347255:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:1.0:1789264246.347308:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055046ff8 reply state 000000009c445b95 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.347321:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7bc9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.347328:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c39824a1400) 00010000:00010000:1.0:1789264246.347338:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789264246.347342:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789264246.347445:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+70:12455:x1876179311232384:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 494us (732us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789264246.347453:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 238 00000100:00100000:1.0:1789264246.350443:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264246.350517:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311232512 00000100:00100000:0.0:1789264246.350527:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311232512 00000100:00100000:0.0:1789264246.350584:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 239 00000100:00100000:0.0:1789264246.350594:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+70:12455:x1876179311232512:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264246.350616:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264246.350636:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7bd0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae11 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.350690:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae11 expref: 71 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.350704:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae11 expref: 71 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.350721:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c39824a1400) 00010000:00010000:0.0:1789264246.350724:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789264246.350727:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836ca600, rc 0) 00000100:00100000:0.0:1789264246.350821:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+71:12455:x1876179311232512:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 229us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264246.350829:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 239 00000100:00100000:3.0:1789264246.353451:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264246.353687:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311232640 00000100:00100000:2.0:1789264246.353697:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311232640 00000100:00100000:2.0:1789264246.353931:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 71 00000100:00100000:2.0:1789264246.353956:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2403:x1876179311232640:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789264246.354357:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+10:2403:x1876179311232640:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 403us (912us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789264246.354368:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 71 00000100:00100000:3.0:1789264246.356844:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264246.356969:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311232896 00000100:00100000:1.0:1789264246.356987:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311232896 00000100:00100000:1.0:1789264246.357083:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:1.0:1789264246.357093:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+71:12455:x1876179311232896:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789264246.357330:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+72:12455:x1876179311232896:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 238us (495us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1789264246.357338:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:2.0:1789264246.359468:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264246.359555:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311233152 00000100:00100000:3.0:1789264246.359564:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311233152 00000100:00100000:3.0:1789264246.359631:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 240 00000100:00100000:3.0:1789264246.359654:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+72:12455:x1876179311233152:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789264246.359774:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+72:12455:x1876179311233152:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 123us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264246.359781:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 240 00000100:00100000:3.0:1789264246.361916:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264246.362021:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311233280 00000100:00100000:2.0:1789264246.362030:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311233280 00000100:00100000:2.0:1789264246.362110:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 241 00000100:00100000:2.0:1789264246.362119:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+72:12455:x1876179311233280:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789264246.362139:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264246.362170:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7bd7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae18 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.362254:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7bde lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.362269:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7bde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.362279:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7bde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264246.362321:0:9197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264246.362338:0:9197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7bde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.362363:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed7bd7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae18 expref: 74 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.362400:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7bde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae18 expref: 73 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.362409:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c39824a1400) 00010000:00010000:2.0:1789264246.362412:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789264246.362415:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1d200, rc 0) 00000100:00100000:2.0:1789264246.362469:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+73:12455:x1876179311233280:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 350us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264246.362476:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 241 00000100:00100000:3.0:1789264246.365620:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264246.365721:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311233408 00000100:00100000:0.0:1789264246.365730:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311233408 00000100:00100000:0.0:1789264246.365925:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 72 00000100:00100000:0.0:1789264246.365936:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+10:2402:x1876179311233408:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264246.365953:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264246.365985:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a135fb5/0xecaf9f2f14ed7be5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae1f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789264246.366023:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa60176, blocks: 0x0 00010000:00010000:0.0:1789264246.366052:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=326s v=(0 0) 00010000:00010000:0.0:1789264246.366058:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264246.366067:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a135fb5/0xecaf9f2f14ed7be5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae1f expref: 11 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.366087:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a135fb5/0xecaf9f2f14ed7be5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae1f expref: 11 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.366100:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836cb600, rc 0) 00000100:00100000:0.0:1789264246.366161:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+11:2402:x1876179311233408:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 218us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264246.366168:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 72 00000100:00100000:2.0:1789264246.368974:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264246.369179:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311233664 00000100:00100000:1.0:1789264246.369189:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311233664 00000100:00100000:1.0:1789264246.369245:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 242 00000100:00100000:1.0:1789264246.369256:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+73:12455:x1876179311233664:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789264246.369360:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+73:12455:x1876179311233664:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 106us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264246.369368:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 242 00000100:00100000:1.0:1789264246.374028:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264246.374194:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311233792 00000100:00100000:2.0:1789264246.374204:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311233792 00000100:00100000:2.0:1789264246.374263:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 73 00000100:00100000:2.0:1789264246.374272:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+11:12455:x1876179311233792:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789264246.374288:0:10317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264246.374307:0:10317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000750b83f7/0xecaf9f2f14ed7bec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae26 expref: -99 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.374339:0:10317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a135fb5/0xecaf9f2f14ed7be5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae1f expref: 12 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.374348:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264246.374352:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264246.374356:0:10317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000750b83f7/0xecaf9f2f14ed7bec lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae26 expref: 12 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.374419:0:10317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a135fb5/0xecaf9f2f14ed7be5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae1f expref: 12 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.374433:0:10317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a135fb5/0xecaf9f2f14ed7be5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae1f expref: 12 pid: 8405 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264246.374447:0:10317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39844b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10317:1876179322795136:192.168.203.44@tcp:104: 00000100:00100000:2.0:1789264246.374541:0:10317:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2d36cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264246.377104:0:10317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39844b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10317:1876179322795136:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264246.377141:0:10317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000750b83f7/0xecaf9f2f14ed7bec lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae26 expref: 12 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.377173:0:10317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1dc00, rc 0) 00000100:00100000:3.0:1789264246.377229:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+12:12455:x1876179311233792:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 2957us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264246.377238:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 73 00000100:00100000:3.0:1789264246.378911:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264246.379030:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311233920 00000100:00100000:1.0:1789264246.379049:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311233920 00010000:00010000:1.0:1789264246.379086:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a135fb5/0xecaf9f2f14ed7be5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae1f expref: 12 pid: 8405 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264246.379118:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 103 00000100:00100000:1.0:1789264246.379142:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984659880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+12:2403:x1876179311233920:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264246.379333:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264246.379357:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a135fb5/0xecaf9f2f14ed7be5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae1f expref: 12 pid: 8405 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.379374:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a135fb5/0xecaf9f2f14ed7be5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae1f expref: 12 pid: 8405 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.379409:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a135fb5/0xecaf9f2f14ed7be5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae1f expref: 12 pid: 8405 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.379428:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264246.379432:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264246.379442:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000750b83f7/0xecaf9f2f14ed7bec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae26 expref: 11 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.379454:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000750b83f7/0xecaf9f2f14ed7bec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae26 expref: 11 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.379493:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000750b83f7/0xecaf9f2f14ed7bec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae26 expref: 11 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264246.379507:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6475:1876179322795264:192.168.203.44@tcp:105: 00000100:00100000:1.0:1789264246.379627:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264246.382782:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6475:1876179322795264:192.168.203.44@tcp:105: 00010000:00010000:0.0:1789264246.382812:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264246.382882:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984659880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+11:2403:x1876179311233920:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 3741us (3977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264246.382892:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 103 00000100:00100000:3.0:1789264246.392837:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264246.392917:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311234048 00000100:00100000:0.0:1789264246.392926:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311234048 00002000:00100000:0.0:1789264246.392968:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9c3984658a80 x1876179311234048/t0(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:327/0 lens 504/0 e 0 to 0 dl 1789264257 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789264246.392989:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3984658a80 with x1876179311234048 ext(0->12) 00002000:00010000:0.0:1789264246.392994:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c3984658a80 00000100:00100000:0.0:1789264246.393168:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:0.0:1789264246.393179:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+11:2403:x1876179311234048:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789264246.393986:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+13:2403:x1876179311234048:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 Request processed in 798us (1146us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789264246.396280:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264246.396616:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311234176 00000100:00100000:1.0:1789264246.396638:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311234176 00000100:00100000:1.0:1789264246.396698:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 243 00000100:00100000:1.0:1789264246.396708:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+73:12455:x1876179311234176:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789264246.398484:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00002000:00100000:0.0:1789264246.398502:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9c3984658a80 x1876179311234048/t4294967322(0) o4->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:327/0 lens 504/448 e 0 to 0 dl 1789264257 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789264246.398514:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3984658a80 with x1876179311234048 ext(0->12) 00002000:00010000:0.0:1789264246.398520:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c3984658a80 00000001:00080000:3.0:1789264246.398792:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1789264246.398817:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:0.0:1789264246.398885:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.398895:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.398901:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.398907:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264246.398911:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.398918:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.398933:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c3aa98f2400) 00010000:00010000:0.0:1789264246.398936:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264246.398941:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78f1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.398957:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed78f1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.398993:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7999 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.398999:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7999 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399004:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7999 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399008:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836caa00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264246.399011:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7999 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399018:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7999 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399026:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264246.399028:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264246.399039:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7999 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399045:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7999 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399058:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7a17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399063:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7a17 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399086:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7a17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399090:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cb800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264246.399093:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7a17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399099:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7a17 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399106:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c39824a1c00) 00010000:00010000:0.0:1789264246.399108:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264246.399111:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7a17 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399115:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7a17 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399125:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7a3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399131:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7a3a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399136:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7a3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399141:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836ca200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264246.399143:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7a3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399168:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7a3a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399179:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c39824a1c00) 00010000:00010000:0.0:1789264246.399181:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264246.399183:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7a3a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399189:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7a3a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399203:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7b0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399209:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7b0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399214:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7b0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399220:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264246.399223:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7b0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399228:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7b0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399235:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:0.0:1789264246.399238:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264246.399241:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7b0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399256:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7b0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399270:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7bc9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399276:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7bc9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399281:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7bc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399286:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45e00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264246.399289:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7bc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399294:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7bc9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399302:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c39824a1400) 00010000:00010000:0.0:1789264246.399304:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789264246.399307:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7bc9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.399313:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45e00/0xecaf9f2f14ed7bc9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264246.399727:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322795392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789264246.399832:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264246.399987:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322795392 00000100:00100000:0.0:1789264246.399995:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322795392 00000100:00100000:0.0:1789264246.400046:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789264246.400056:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3623:x1876179322795392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789264246.400089:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:0.0:1789264246.400116:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa60175, atime: 0x6aa60175, ctime: 0x6aa60175, blocks: 0x8 00010000:00010000:0.0:1789264246.400122:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed7bf3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.400137:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=326s v=(0 0) 00010000:00010000:0.0:1789264246.400141:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264246.400311:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed7bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.400330:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed7bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.400339:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed7bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.400346:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed7bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.400363:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1789264246.400644:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c3a8c49a0c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789264246.400649:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c398307fe00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c3ab6805600 00000020:00080000:3.0:1789264246.400653:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c3abaadb200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c39825eea00 00000004:00080000:3.0:1789264246.400675:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1789264246.400710:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c3ab2d36300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789264246.400713:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c3abaadb700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c3ab2d36240 00000020:00080000:3.0:1789264246.400716:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c3abaadb800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c3a8e871800 00000020:00080000:3.0:1789264246.400763:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789264246.400806:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789264246.400998:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789264246.401012:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322795520:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789264246.401056:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264246.401094:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322795520 00000100:00100000:1.0:1789264246.401099:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322795520 00000100:00100000:1.0:1789264246.401135:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789264246.401143:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1876179322795520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789264246.401180:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1789264246.401198:0:8406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086ff2f3b/0xecaf9f2f14ed7bfa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.401215:0:8406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed79a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad7e expref: 12 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.401222:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789264246.401225:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789264246.401229:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086ff2f3b/0xecaf9f2f14ed7bfa lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.401255:0:8406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed79a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad7e expref: 12 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.401268:0:8406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed79a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad7e expref: 12 pid: 10317 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264246.401291:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1876179322795648:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264246.401342:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a1cc0 going to sleep for 11 seconds 00000100:00080000:1.0:1789264246.401359:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789264246.401550:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+21:12455:x1876179311234176:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 Request processed in 4843us (5276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264246.401558:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 243 00010000:00010000:3.0:1789264246.402284:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264246.402294:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed7bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.402305:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cb000 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264246.402309:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed7bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.402319:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed7bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.402338:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed7bf3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.402345:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed7bf3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.402365:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264246.402367:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264246.402368:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264246.403150:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3623:x1876179322795392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3090us (3313us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789264246.403162:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:2.0:1789264246.403208:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c3983fb6680/2, rc 0, transno 4294967311 00000100:00100000:2.0:1789264246.403215:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322795392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789264246.405181:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264246.405217:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264246.405247:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311234432 00000100:00100000:3.0:1789264246.405255:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311234432 00000100:00100000:3.0:1789264246.405303:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 76 00000100:00100000:3.0:1789264246.405313:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+13:2402:x1876179311234432:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789264246.405485:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311234304 00000100:00100000:0.0:1789264246.405489:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311234304 00010000:00010000:0.0:1789264246.405512:0:7892:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed79a7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad7e expref: 14 pid: 10317 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264246.405558:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 104 00000100:00100000:0.0:1789264246.405565:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+14:2402:x1876179311234304:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264246.405576:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264246.405582:0:7892:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed79a7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad7e expref: 14 pid: 10317 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.405595:0:7892:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed79a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad7e expref: 14 pid: 10317 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.405620:0:7892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789264246.405625:0:7892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789264246.405630:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086ff2f3b/0xecaf9f2f14ed7bfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.405640:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086ff2f3b/0xecaf9f2f14ed7bfa lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.405659:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264246.405702:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+14:2402:x1876179311234304:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 138us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264246.405709:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 104 00000001:00080000:0.0:1789264246.406467:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1789264246.406478:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:2.0:1789264246.406814:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed79a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad7e expref: 13 pid: 10317 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264246.406833:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1876179322795648:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264246.406856:0:8406:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000086ff2f3b/0xecaf9f2f14ed7bfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.406867:0:8406:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000086ff2f3b/0xecaf9f2f14ed7bfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.406887:0:8406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086ff2f3b/0xecaf9f2f14ed7bfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.406898:0:8406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086ff2f3b/0xecaf9f2f14ed7bfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.406905:0:8406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086ff2f3b/0xecaf9f2f14ed7bfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.406930:0:8406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789264246.407503:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264246.407517:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086ff2f3b/0xecaf9f2f14ed7bfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.407526:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45c00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:0.0:1789264246.407530:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086ff2f3b/0xecaf9f2f14ed7bfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.407538:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086ff2f3b/0xecaf9f2f14ed7bfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.407557:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086ff2f3b/0xecaf9f2f14ed7bfa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.407565:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086ff2f3b/0xecaf9f2f14ed7bfa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.407588:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264246.407590:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264246.407592:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264246.408046:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3625:x1876179322795520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6901us (6987us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789264246.408164:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:2.0:1789264246.408480:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c3983fb6d80/2, rc 0, transno 4294967323 00000100:00100000:2.0:1789264246.408554:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322795520:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789264246.409577:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1789264246.409594:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000100:00100000:0.0:1789264246.409738:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2402:x1876179311234432:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 Request processed in 4424us (4517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264246.409787:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 76 00010000:00010000:2.0:1789264246.411114:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264246.416842:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264246.416943:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311234688 00000100:00100000:0.0:1789264246.416953:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311234688 00000100:00100000:0.0:1789264246.417022:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 244 00000100:00100000:0.0:1789264246.417042:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+21:12455:x1876179311234688:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789264246.417102:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264246.417140:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d200/0xecaf9f2f14ed7bde lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae18 expref: 21 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.417169:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c39824a1400) 00010000:00010000:0.0:1789264246.417174:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264246.417203:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7c01 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.417216:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7c01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.417227:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7c01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789264246.417341:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d3e3faf reply state 00000000b8c836e9 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7c01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.417354:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7c01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.417360:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c39824a1400) 00010000:00010000:0.0:1789264246.417362:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789264246.417365:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789264246.417468:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+22:12455:x1876179311234688:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 435us (634us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1789264246.417476:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 244 00000100:00100000:3.0:1789264246.420702:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264246.420805:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311234816 00000100:00100000:1.0:1789264246.420814:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311234816 00000100:00100000:1.0:1789264246.420863:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 77 00000100:00100000:1.0:1789264246.420873:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2403:x1876179311234816:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789264246.421015:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789264246.421019:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789264246 00002000:00010000:1.0:1789264246.421021:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789264245 00002000:00010000:1.0:1789264246.421023:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789264246 -> 1789264246 00002000:00010000:1.0:1789264246.421025:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789264246.421095:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2403:x1876179311234816:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 214us (392us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789264246.421102:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 77 00000100:00100000:2.0:1789264246.424269:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264246.424369:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311235072 00000100:00100000:3.0:1789264246.424388:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311235072 00000100:00100000:3.0:1789264246.424539:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 245 00000100:00100000:3.0:1789264246.424551:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+22:12455:x1876179311235072:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789264246.424614:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.424631:0:7904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed7bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae0a expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.424640:0:7904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.424673:0:7904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed7bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae0a expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.424686:0:7904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed7bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae0a expref: 22 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264246.424700:0:7904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7904:1876179322795776:192.168.203.44@tcp:104: 00000100:00100000:3.0:1789264246.424812:0:7904:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789264246.428580:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264246.428664:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311235200 00000100:00100000:0.0:1789264246.428673:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311235200 00010000:00010000:0.0:1789264246.428713:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed7bc2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae0a expref: 23 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264246.428801:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 105 00000100:00100000:0.0:1789264246.428812:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+23:2402:x1876179311235200:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264246.428827:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264246.428834:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed7bc2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae0a expref: 23 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.428847:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed7bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae0a expref: 23 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.428869:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c39824a1400) 00010000:00010000:0.0:1789264246.428875:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.428884:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.428892:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.428910:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264246.428967:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+23:2402:x1876179311235200:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 157us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264246.428975:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 105 00010000:00010000:2.0:1789264246.429655:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed7bc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae0a expref: 22 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264246.429674:0:7904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7904:1876179322795776:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264246.429699:0:7904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.429706:0:7904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.429712:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.429926:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.429934:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.429940:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.429945:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264246.429948:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.429955:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.429965:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c39824a1400) 00010000:00010000:2.0:1789264246.429967:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789264246.429971:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.429987:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b400/0xecaf9f2f14ed7c08 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264246.430057:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+21:12455:x1876179311235072:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 Request processed in 5509us (5797us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789264246.430067:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 245 00000100:00100000:3.0:1789264246.436366:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264246.436473:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311235328 00000100:00100000:1.0:1789264246.436483:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311235328 00000100:00100000:1.0:1789264246.436542:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 78 00000100:00100000:1.0:1789264246.436553:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2403:x1876179311235328:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789264246.436605:0:11052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000853c69a8/0xecaf9f2f14ed7c0f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.436627:0:11052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000750b83f7/0xecaf9f2f14ed7bec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae26 expref: 8 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.436636:0:11052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264246.436640:0:11052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789264246.436644:0:11052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000853c69a8/0xecaf9f2f14ed7c0f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.436678:0:11052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000750b83f7/0xecaf9f2f14ed7bec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae26 expref: 8 pid: 10317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.436692:0:11052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000750b83f7/0xecaf9f2f14ed7bec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae26 expref: 8 pid: 10317 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264246.436705:0:11052:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11052:1876179322795904:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264246.436819:0:11052:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a1540 going to sleep for 11 seconds 00000100:00100000:3.0:1789264246.446165:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264246.446305:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311235456 00000100:00100000:0.0:1789264246.446315:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311235456 00010000:00010000:0.0:1789264246.446353:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000750b83f7/0xecaf9f2f14ed7bec lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae26 expref: 9 pid: 10317 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264246.446425:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 106 00000100:00100000:0.0:1789264246.446437:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984659180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2403:x1876179311235456:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264246.446466:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264246.446489:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000750b83f7/0xecaf9f2f14ed7bec lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae26 expref: 9 pid: 10317 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.446502:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000750b83f7/0xecaf9f2f14ed7bec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae26 expref: 9 pid: 10317 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.446529:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789264246.446533:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789264246.446539:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000853c69a8/0xecaf9f2f14ed7c0f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.446550:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000853c69a8/0xecaf9f2f14ed7c0f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.446571:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264246.446628:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984659180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+9:2403:x1876179311235456:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 193us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264246.446635:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 106 00010000:00010000:1.0:1789264246.447567:0:11052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000750b83f7/0xecaf9f2f14ed7bec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae26 expref: 8 pid: 10317 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264246.447588:0:11052:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11052:1876179322795904:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264246.447610:0:11052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000853c69a8/0xecaf9f2f14ed7c0f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.447637:0:11052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000853c69a8/0xecaf9f2f14ed7c0f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.447644:0:11052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000853c69a8/0xecaf9f2f14ed7c0f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.447666:0:11052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000853c69a8/0xecaf9f2f14ed7c0f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.447674:0:11052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000853c69a8/0xecaf9f2f14ed7c0f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.447682:0:11052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000853c69a8/0xecaf9f2f14ed7c0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.447690:0:11052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44400 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264246.447694:0:11052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000853c69a8/0xecaf9f2f14ed7c0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.447702:0:11052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000853c69a8/0xecaf9f2f14ed7c0f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.447717:0:11052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000853c69a8/0xecaf9f2f14ed7c0f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.447735:0:11052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000853c69a8/0xecaf9f2f14ed7c0f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264246.447866:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2403:x1876179311235328:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 Request processed in 11314us (11508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264246.447875:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 78 00000100:00100000:3.0:1789264246.450002:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264246.450079:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311235712 00000100:00100000:1.0:1789264246.450098:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311235712 00000100:00100000:1.0:1789264246.450160:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 246 00000100:00100000:1.0:1789264246.450170:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+21:12455:x1876179311235712:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789264246.450242:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.450258:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7b05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd2 expref: 21 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.450269:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.450302:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7b05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd2 expref: 21 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.450314:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7b05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd2 expref: 21 pid: 7904 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264246.450329:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322796032:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264246.450426:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a1540 going to sleep for 11 seconds 00000100:00100000:3.0:1789264246.453263:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264246.455559:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311235840 00000100:00100000:0.0:1789264246.455573:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311235840 00010000:00010000:0.0:1789264246.455618:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7b05 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd2 expref: 22 pid: 7904 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264246.455691:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 107 00000100:00100000:0.0:1789264246.455701:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+22:2402:x1876179311235840:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264246.455716:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264246.455723:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7b05 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd2 expref: 22 pid: 7904 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.455737:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7b05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd2 expref: 22 pid: 7904 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.455805:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:0.0:1789264246.455811:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadf5 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.455822:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.455830:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.455837:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.455857:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264246.455914:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+22:2402:x1876179311235840:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 215us (2659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264246.455922:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 107 00010000:00010000:1.0:1789264246.456447:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36bc00/0xecaf9f2f14ed7b05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadd2 expref: 21 pid: 7904 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264246.456466:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322796032:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264246.456488:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.456497:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.456503:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.456660:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.456671:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7bd0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae11 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.456679:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.456704:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae11 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.456718:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7bd0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae11 expref: 21 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264246.456731:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322796160:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264246.458243:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789264246.463676:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322796160:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264246.463708:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264246.472651:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264246.477674:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311235968 00000100:00100000:1.0:1789264246.477689:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311235968 00010000:00010000:0.0:1789264246.481641:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7bd0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae11 expref: 22 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264246.481701:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 108 00000100:00100000:0.0:1789264246.481713:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+22:2403:x1876179311235968:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264246.481730:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264246.481737:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7bd0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae11 expref: 22 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.481774:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae11 expref: 22 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.481798:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7bd0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae11 expref: 22 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.481821:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c39824a1400) 00010000:00010000:0.0:1789264246.481826:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.481837:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.481844:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.482111:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264246.482190:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+21:2403:x1876179311235968:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 478us (9547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264246.482199:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 108 00010000:00010000:1.0:1789264246.484461:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.484476:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789264246.484590:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1789264246.484716:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1789264246.484767:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1789264246.484849:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6492:1876179322796288:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789264246.484910:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264246.484934:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322796288 00000100:00100000:2.0:1789264246.484942:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322796288 00000100:00100000:1.0:1789264246.484953:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789264246.485015:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789264246.485024:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6492:x1876179322796288:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789264246.485222:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6492:x1876179322796288:12345-0@lo:1000:mdt00_002.0 Request processed in 198us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264246.485229:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789264246.485490:0:6492:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967319 gen 2 00000004:00080000:1.0:1789264246.485496:0:6492:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967319 committed transno 4294967319 00000100:00100000:1.0:1789264246.485518:0:6492:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c3983fb6d80 x1876179322795520/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789264262 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264246.485586:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6492:1876179322796288:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789264246.486655:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1789264246.486736:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6492:1876179322796416:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789264246.486815:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264246.486858:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a1540 going to sleep for 11 seconds 00000100:00100000:0.0:1789264246.487110:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322796416 00000100:00100000:0.0:1789264246.487117:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322796416 00000100:00100000:0.0:1789264246.487178:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789264246.487188:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6492:x1876179322796416:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789264246.487320:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6492:x1876179322796416:12345-0@lo:1000:mdt00_002.0 Request processed in 134us (504us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789264246.487327:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789264246.487792:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6492:1876179322796416:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789264246.487847:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.487857:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.487865:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.487871:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45c00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264246.487875:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.487882:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.487896:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c39824a1400) 00010000:00010000:1.0:1789264246.487899:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789264246.487903:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.487910:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c1d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.487932:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7b60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.487937:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7b60 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.487943:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7b60 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.487957:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264246.487960:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7b60 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.487966:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7b60 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.487975:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:1.0:1789264246.487977:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789264246.487984:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadf5 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.487995:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b67 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadf5 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.488003:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadf5 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.488031:0:6492:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadf5 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264246.488044:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322796544:192.168.203.44@tcp:105: 00000100:00100000:1.0:1789264246.488173:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1789264246.498388:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264246.498465:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311236096 00000100:00100000:0.0:1789264246.498475:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311236096 00000100:00100000:0.0:1789264246.498534:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:0.0:1789264246.498545:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+25:12454:x1876179311236096:12345-192.168.203.44@tcp:49:lfs.0 00000100:00100000:0.0:1789264246.498667:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+25:12454:x1876179311236096:12345-192.168.203.44@tcp:49:lfs.0 Request processed in 124us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264246.498675:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:1.0:1789264246.499140:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876179322796544:192.168.203.44@tcp:105: 00010000:00010000:1.0:1789264246.499168:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7b60 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499196:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a800/0xecaf9f2f14ed7b60 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499229:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c24 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499242:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c24 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499253:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c24 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499262:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c24 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499268:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c24 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499275:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c24 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499281:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45c00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264246.499285:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c24 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499291:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c24 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499302:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:1.0:1789264246.499304:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789264246.499307:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c24 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499319:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45c00/0xecaf9f2f14ed7c24 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499329:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499334:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499338:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499342:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44c00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264246.499345:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499349:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499356:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:1.0:1789264246.499358:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789264246.499360:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.499365:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed7c16 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264246.499635:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+24:12455:x1876179311235712:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 49465us (49639us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789264246.499644:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 246 00000020:00080000:1.0:1789264246.499654:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789264246.499795:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789264246.499799:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789264246.501210:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789264246.501226:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789264246.502157:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264246.502194:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264246.502314:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311236352 00000100:00100000:1.0:1789264246.502324:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311236352 00000100:00100000:1.0:1789264246.502377:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 247 00000100:00100000:1.0:1789264246.502397:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+24:12454:x1876179311236352:12345-192.168.203.44@tcp:58:lfs.0 00000100:00100000:0.0:1789264246.502432:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311236608 00000100:00100000:0.0:1789264246.502444:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311236608 00000100:00100000:0.0:1789264246.502513:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:0.0:1789264246.502520:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab27a5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+25:12455:x1876179311236608:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1789264246.502559:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789264246.502635:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+26:12454:x1876179311236352:12345-192.168.203.44@tcp:58:lfs.0 Request processed in 239us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264246.502643:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 247 00000004:00080000:0.0:1789264246.502704:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789264246.502734:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1789264246.502799:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.502814:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.502824:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.502851:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c2b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.502859:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c2b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.502865:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c2b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.502884:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789264246.502941:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab27a5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+26:12455:x1876179311236608:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 421us (747us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789264246.502947:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 62 00000020:00080000:0.0:1789264246.502951:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789264246.503311:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264246.503317:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c2b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.503325:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836ca600 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264246.503329:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c2b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.503336:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c2b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.503349:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c39824a1400) 00010000:00010000:1.0:1789264246.503352:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789264246.503356:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c2b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.503362:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c2b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264246.503373:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264246.503375:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264246.503377:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264246.533741:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264246.534093:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311236736 00000100:00100000:3.0:1789264246.534104:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311236736 00000100:00100000:3.0:1789264246.534428:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 248 00000100:00100000:3.0:1789264246.534441:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+26:12457:x1876179311236736:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1789264246.534465:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264246.534487:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7c32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae2d expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.534551:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7c39 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.534565:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7c39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.534575:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7c39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.534587:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7c40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.534662:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7c40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.534671:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7c40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.534779:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7c47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.534850:0:7904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadee expref: 27 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.534856:0:7904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7c47 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.534884:0:7904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadee expref: 27 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264246.534894:0:7904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadee expref: 27 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264246.534903:0:7904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7904:1876179322796672:192.168.203.44@tcp:104: 00000100:00100000:3.0:1789264246.534997:0:7904:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c520c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264246.537318:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264246.537439:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311236992 00000100:00100000:1.0:1789264246.537448:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311236992 00000100:00100000:1.0:1789264246.537507:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:1.0:1789264246.537518:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+28:6164:x1876179311236992:12345-192.168.203.44@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789264246.537719:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+29:6164:x1876179311236992:12345-192.168.203.44@tcp:35:ldlm_bl.0 Request processed in 203us (409us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789264246.537727:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:2.0:1789264246.537795:0:7904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7904:1876179322796672:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264246.537823:0:7904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7c47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264246.539878:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264246.540140:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311237120 00000100:00100000:0.0:1789264246.540149:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311237120 00010000:00010000:0.0:1789264246.540186:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadee expref: 29 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264246.540265:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 109 00000100:00100000:0.0:1789264246.540275:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+29:2403:x1876179311237120:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264246.540288:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264246.540294:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadee expref: 29 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.540307:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadee expref: 29 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.540348:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed7b52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadee expref: 29 pid: 6490 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.540363:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:0.0:1789264246.540369:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7c47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.540389:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7c47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.540397:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7c47 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264246.540423:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789264246.540461:0:7904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7c47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540471:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7c47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264246.540519:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789264246.540523:0:7904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264246.540543:0:7904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7c47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540556:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7c47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540565:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7c39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540583:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7c39 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540590:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7c39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540608:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36ac00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264246.540613:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7c39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540622:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7c39 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540634:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:2.0:1789264246.540637:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264246.540640:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7c39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540647:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7c39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264246.540652:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+28:2403:x1876179311237120:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 376us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264246.540663:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 109 00010000:00010000:2.0:1789264246.540664:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7c40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540673:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7c40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540679:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7c40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540684:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264246.540693:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7c40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540700:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7c40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540710:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c3983362b00) 00010000:00010000:2.0:1789264246.540713:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264246.540717:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7c40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540723:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b200/0xecaf9f2f14ed7c40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540805:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a600/0xecaf9f2f14ed7c32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae2d expref: 28 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540820:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7c47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae2d expref: 27 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264246.540838:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:2.0:1789264246.540841:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789264246.540844:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b800, rc 0) 00000100:00100000:2.0:1789264246.540872:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+27:12457:x1876179311236736:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 6435us (7141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264246.540879:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 248 00000040:00080000:2.0:1789264247.209216:0:14769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789264247.209226:0:14769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789264247.209259:0:14769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789264247.209264:0:14769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789264247.433912:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789264247.561932:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789264247.561940:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789264247.561961:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789264247.562038:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789264247.562168:0:13760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984659c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13760:1876179322796800:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789264247.562284:0:13760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398265a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789264247.566875:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264247.566965:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311237248 00000100:00100000:1.0:1789264247.566974:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311237248 00000100:00100000:3.0:1789264247.566977:0:13760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984659c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13760:1876179322796800:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789264247.567035:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 249 00000100:00100000:1.0:1789264247.567046:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+27:12469:x1876179311237248:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789264247.567078:0:6492:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789264247.567189:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+27:12469:x1876179311237248:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 146us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264247.567197:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 249 00000100:00100000:2.0:1789264247.574710:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264247.574836:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311237504 00000100:00100000:0.0:1789264247.574847:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311237504 00000100:00100000:0.0:1789264247.574908:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 250 00000100:00100000:0.0:1789264247.574919:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+27:12469:x1876179311237504:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264247.574939:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264247.574959:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7c4e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae34 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264247.575064:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7c55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264247.575091:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7c55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264247.575103:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7c55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264247.575120:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789264247.575225:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7c4e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae34 expref: 30 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264247.575241:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7c55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae34 expref: 29 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264247.575251:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:0.0:1789264247.575253:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789264247.575257:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836caa00, rc 0) 00000100:00100000:0.0:1789264247.575318:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+29:12469:x1876179311237504:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 401us (618us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789264247.575325:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 250 00000100:00100000:3.0:1789264247.581677:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264247.581789:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311237760 00000100:00100000:2.0:1789264247.581800:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311237760 00000100:00100000:2.0:1789264247.581872:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 251 00000100:00100000:2.0:1789264247.581882:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+29:12469:x1876179311237760:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789264247.581961:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7c63 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264247.581977:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7c63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264247.581990:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7c63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264247.582124:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7c63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264247.582144:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7c63 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264247.582151:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7c63 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264247.582157:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1cc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264247.582161:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7c63 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264247.582167:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7c63 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264247.582179:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:2.0:1789264247.582189:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789264247.582195:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7c63 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264247.582201:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1cc00/0xecaf9f2f14ed7c63 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264247.582319:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+30:12469:x1876179311237760:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 437us (651us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789264247.582457:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 251 00000040:00080000:3.0:1789264247.583143:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789264247.583150:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789264247.583639:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789264247.583651:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789264247.585414:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264247.585499:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264247.585579:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311238144 00000100:00100000:2.0:1789264247.585588:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311238144 00000100:00100000:2.0:1789264247.585646:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:2.0:1789264247.585656:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+30:12469:x1876179311238144:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789264247.585728:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311237888 00000100:00100000:3.0:1789264247.585732:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311237888 00000100:00100000:3.0:1789264247.585788:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:3.0:1789264247.585796:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+32:2402:x1876179311237888:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264247.585806:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264247.585829:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836caa00/0xecaf9f2f14ed7c55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae34 expref: 32 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264247.585845:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:3.0:1789264247.585849:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264247.585896:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+31:12469:x1876179311238144:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 238us (392us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789264247.585904:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:3.0:1789264247.586463:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+30:2402:x1876179311237888:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 666us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264247.586471:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:1.0:1789264247.819388:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322797312:0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.819462:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264247.819516:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322796928:0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.819528:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322797824:0@lo:400:kworker.0 00000004:00080000:0.0:1789264247.819543:0:10066:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328160796325ns, next at 329160792942ns, rc = 0 00000100:00100000:3.0:1789264247.819562:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264247.819570:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264247.819587:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322797184:0@lo:400:kworker.0 00000100:00100000:3.0:1789264247.819595:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322797440:0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.819603:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39846bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322798336:0@lo:400:kworker.0 00000100:00100000:0.0:1789264247.819636:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264247.819642:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264247.819678:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322797824 00000100:00100000:0.0:1789264247.819680:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1876179322797696:0@lo:400:kworker.0 00000100:00100000:3.0:1789264247.819694:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322797824 00000100:00100000:1.0:1789264247.819703:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322798336 00000100:00100000:1.0:1789264247.819709:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322798336 00000100:00100000:2.0:1789264247.819849:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322796928 00000100:00100000:2.0:1789264247.819854:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322796928 00000100:00100000:2.0:1789264247.819888:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1789264247.819896:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3625:x1876179322796928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264247.819940:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264247.819949:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3625:x1876179322796928:12345-0@lo:400:kworker.0 Request processed in 51us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264247.819957:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789264247.819966:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39846bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322798208:0@lo:400:kworker.0 00000100:00100000:0.0:1789264247.819993:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264247.820007:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322797184 00000100:00100000:2.0:1789264247.820012:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322797184 00000100:00100000:0.0:1789264247.820036:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322798720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264247.820050:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789264247.820061:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322797184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264247.820065:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264247.820086:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1789264247.820094:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322797056:0@lo:400:kworker.0 00000100:00100000:2.0:1789264247.820115:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322797184:12345-0@lo:400:kworker.0 Request processed in 56us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264247.820128:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789264247.820128:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264247.820168:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264247.820188:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322797952:0@lo:400:kworker.0 00000100:00100000:0.0:1789264247.820220:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322797568:0@lo:400:kworker.0 00000100:00100000:0.0:1789264247.820246:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264247.820262:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39846bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322798080:0@lo:400:kworker.0 00000100:00100000:0.0:1789264247.820294:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264247.820309:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322798592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264247.820725:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264247.820732:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264247.821258:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322797184:0@lo:400:kworker.0 00000100:00100000:2.0:1789264247.825321:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39846bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322798464:0@lo:400:kworker.0 00000100:00100000:2.0:1789264247.825389:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264247.825394:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789264247.825422:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322797824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264247.825427:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322796928:0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.825490:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322797824:12345-0@lo:400:kworker.0 Request processed in 72us (5918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264247.825491:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322798464 00000100:00100000:0.0:1789264247.825499:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322798464 00000100:00100000:1.0:1789264247.825502:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789264247.825526:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789264247.825533:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789264247.825538:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322798336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264247.825546:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3625:x1876179322798464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.825579:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322798336:12345-0@lo:400:kworker.0 Request processed in 46us (5938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264247.825588:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789264247.825594:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3625:x1876179322798464:12345-0@lo:400:kworker.0 Request processed in 51us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264247.825602:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1789264247.825617:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789264247.825624:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264247.825629:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322797440 00000100:00100000:0.0:1789264247.825634:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322797440 00000100:00100000:0.0:1789264247.825657:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789264247.825662:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322797440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264247.825686:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322797440:12345-0@lo:400:kworker.0 Request processed in 24us (5519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264247.825713:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322797312 00000100:00100000:3.0:1789264247.825877:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322797952 00000100:00100000:3.0:1789264247.825882:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322797952 00000100:00100000:3.0:1789264247.826039:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789264247.826057:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322797312 00000100:00100000:1.0:1789264247.826085:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322797696 00000100:00100000:1.0:1789264247.826088:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322797696 00000100:00100000:1.0:1789264247.826105:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322798208 00000100:00100000:1.0:1789264247.826109:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322798208 00000100:00100000:1.0:1789264247.826129:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322797056 00000100:00100000:1.0:1789264247.826134:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322797056 00000100:00100000:2.0:1789264247.826135:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322797440:0@lo:400:kworker.0 00000100:00100000:2.0:1789264247.826150:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39846bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322798464:0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.826152:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322797568 00000100:00100000:1.0:1789264247.826157:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322797568 00000100:00100000:1.0:1789264247.826176:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322798080 00000100:00100000:1.0:1789264247.826180:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322798080 00000100:00100000:1.0:1789264247.826196:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789264247.826203:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322797312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.826239:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322797312:12345-0@lo:400:kworker.0 Request processed in 36us (6777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264247.826246:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789264247.826258:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789264247.826272:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1876179322797696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264247.826291:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322797952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.826318:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1876179322797696:12345-0@lo:400:kworker.0 Request processed in 45us (6379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264247.826325:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789264247.826340:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322797952:12345-0@lo:400:kworker.0 Request processed in 53us (5615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264247.826344:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789264247.826356:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1876179322798208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264247.826357:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789264247.826389:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322798720 00000100:00100000:3.0:1789264247.826393:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322798720 00000100:00100000:1.0:1789264247.826406:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1876179322798208:12345-0@lo:400:kworker.0 Request processed in 53us (6411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264247.826413:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789264247.826418:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322798592 00000100:00100000:3.0:1789264247.826421:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322798592 00000100:00100000:1.0:1789264247.826431:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789264247.826439:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322797056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.826466:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322797056:12345-0@lo:400:kworker.0 Request processed in 29us (6343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264247.826471:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789264247.826482:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789264247.826488:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab301ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322797568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.826513:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab301ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322797568:12345-0@lo:400:kworker.0 Request processed in 26us (6267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264247.826519:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789264247.826530:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789264247.826535:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322798080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.826560:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322798080:12345-0@lo:400:kworker.0 Request processed in 26us (6266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264247.826566:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789264247.826604:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322797312:0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.826625:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322797824:0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.826637:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39846bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322798336:0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.827119:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322797056:0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.827132:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322797568:0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.827143:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39846bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322798080:0@lo:400:kworker.0 00010000:00080000:1.0:1789264247.827157:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983fb7480 x1876179322797696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264247.827168:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1876179322797696:0@lo:400:kworker.0 00010000:00080000:1.0:1789264247.827181:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39846bf800 x1876179322798208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264247.827189:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39846bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322798208:0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.827232:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789264247.827241:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322798720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789264247.827264:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789264247.827306:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322798720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (7241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264247.827312:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789264247.827359:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789264247.827365:0:3625:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1789264247.827389:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c3983f4bb80, transno 4294967308 00000004:00080000:1.0:1789264247.827398:0:3625:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1789264247.827409:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c3983fb6680, transno 4294967311 00000100:00100000:1.0:1789264247.827424:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322797952:0@lo:400:kworker.0 00000100:00100000:1.0:1789264247.827567:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322798720:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789264247.827596:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789264247.827600:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789264247.827603:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264247.827640:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789264247.829867:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789264247.830172:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1876179322798592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789264247.830328:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789264247.830546:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1876179322798592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 667us (9817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264247.830555:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789264247.830635:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322798592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264248.330092:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322798848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789264248.330170:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264248.330263:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322798848 00000100:00100000:1.0:1789264248.330271:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322798848 00000100:00100000:1.0:1789264248.330332:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789264248.330341:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322798848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789264248.330392:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789264248.330453:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322798848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264248.330459:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789264248.330508:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322798848:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789264248.463046:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264248.785878:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264248.785916:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264248.785952:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264248.785975:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264248.785994:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264248.786014:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264248.786038:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311238272 00000100:00100000:0.0:1789264248.786046:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311238272 00000100:00100000:0.0:1789264248.786088:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 371 00000100:00100000:0.0:1789264248.786097:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2405:x1876179311238272:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264248.786153:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2405:x1876179311238272:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 57us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264248.786160:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 371 00000100:00100000:0.0:1789264248.786187:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311238400 00000100:00100000:0.0:1789264248.786190:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311238400 00000100:00100000:0.0:1789264248.786222:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311238528 00000100:00100000:0.0:1789264248.786224:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311238528 00000100:00100000:0.0:1789264248.786237:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311239040 00000100:00100000:0.0:1789264248.786239:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311239040 00000100:00100000:0.0:1789264248.786251:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 252 00000100:00100000:0.0:1789264248.786257:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+30:2404:x1876179311238400:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264248.786285:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+30:2404:x1876179311238400:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 28us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264248.786291:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 252 00000100:00100000:0.0:1789264248.786301:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 253 00000100:00100000:0.0:1789264248.786307:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311238528:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264248.786326:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2405:x1876179311238528:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 19us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264248.786340:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 253 00000100:00100000:0.0:1789264248.786351:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 254 00000100:00100000:0.0:1789264248.786356:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311239040:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264248.786389:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311239040:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 33us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264248.786395:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 254 00000100:00080000:0.0:1789264248.786506:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789264248.786511:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789264248.787989:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311238656 00000100:00100000:3.0:1789264248.788002:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311238656 00000100:00100000:3.0:1789264248.788055:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311238784 00000100:00100000:3.0:1789264248.788058:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311238784 00000100:00100000:3.0:1789264248.788086:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 106 00000100:00100000:3.0:1789264248.788094:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311238656:12345-192.168.203.44@tcp:400:kworker.0 00000100:00080000:0.0:1789264248.788171:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789264248.788174:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789264248.789010:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2404:x1876179311238656:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 913us (3089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264248.789020:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 106 00000100:00100000:3.0:1789264248.789039:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 107 00000100:00100000:3.0:1789264248.789047:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2405:x1876179311238784:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264248.792591:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264248.792705:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311238912 00000100:00100000:1.0:1789264248.792713:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311238912 00000100:00100000:1.0:1789264248.792782:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 255 00000100:00100000:1.0:1789264248.792790:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311238912:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264248.792849:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2404:x1876179311238912:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 60us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264248.792856:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 255 00000100:00080000:1.0:1789264248.792882:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789264248.793540:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2405:x1876179311238784:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 4492us (7542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264248.793552:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 107 00000040:00080000:1.0:1789264248.876307:0:14820:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789264248.876316:0:14820:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789264248.876359:0:14820:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789264248.877232:0:14820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789264249.022998:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264249.023181:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311239296 00000100:00100000:0.0:1789264249.023191:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311239296 00000100:00100000:0.0:1789264249.023253:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 252 00000100:00100000:0.0:1789264249.023264:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+30:12490:x1876179311239296:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1789264249.023285:0:9197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264249.023308:0:9197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7c6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae3b expref: -99 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264249.023432:0:9197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c71 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264249.023447:0:9197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264249.023460:0:9197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264249.023475:0:9197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789264249.023604:0:9197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb800/0xecaf9f2f14ed7c6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae3b expref: 33 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264249.023621:0:9197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae3b expref: 32 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264249.023630:0:9197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:0.0:1789264249.023632:0:9197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789264249.023636:0:9197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836ca600, rc 0) 00000100:00100000:0.0:1789264249.023697:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+32:12490:x1876179311239296:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 435us (707us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789264249.023704:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 252 00000100:00100000:0.0:1789264249.028701:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264249.028814:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311239424 00000100:00100000:3.0:1789264249.028824:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311239424 00000100:00100000:3.0:1789264249.028882:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 253 00000100:00100000:3.0:1789264249.028893:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+32:12490:x1876179311239424:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:3.0:1789264249.028957:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7c7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264249.028972:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264249.028984:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264249.029015:0:7904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264249.029023:0:7904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7c7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264249.029029:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7c7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264249.029035:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264249.029038:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7c7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264249.029046:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7c7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264249.029057:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:3.0:1789264249.029060:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789264249.029072:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7c7f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264249.029079:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b000/0xecaf9f2f14ed7c7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264249.029145:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+32:12490:x1876179311239424:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 254us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264249.029153:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 253 00000100:00100000:2.0:1789264249.126287:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264249.127697:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311239552 00000100:00100000:0.0:1789264249.127710:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311239552 00000100:00100000:0.0:1789264249.127839:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 79 00000100:00100000:0.0:1789264249.127852:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2405:x1876179311239552:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:2.0:1789264249.128592:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264249.128621:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003531cad7/0xecaf9f2f14ed7c86 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae42 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789264249.128650:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa60176, atime: 0x6aa60175, ctime: 0x6aa60176, blocks: 0x8 00010000:00010000:2.0:1789264249.128671:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1789264249.128675:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264249.128686:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003531cad7/0xecaf9f2f14ed7c86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae42 expref: 8 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264249.128705:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003531cad7/0xecaf9f2f14ed7c86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae42 expref: 8 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264249.128738:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c000, rc 0) 00000100:00100000:2.0:1789264249.128839:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2405:x1876179311239552:12345-192.168.203.44@tcp:101:cat.0 Request processed in 991us (2560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264249.128846:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 79 00000100:00100000:0.0:1789264249.135519:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264249.135596:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311239680 00000100:00100000:3.0:1789264249.135606:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311239680 00002000:00100000:3.0:1789264249.135654:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9c3984641c00 x1876179311239680/t0(0) o3->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:330/0 lens 488/0 e 0 to 0 dl 1789264260 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789264249.135667:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3984641c00 with x1876179311239680 ext(0->4095) 00002000:00010000:3.0:1789264249.135672:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c3984641c00 00000100:00100000:3.0:1789264249.135711:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:3.0:1789264249.135721:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2403:x1876179311239680:12345-192.168.203.44@tcp:3:cat.0 00000100:00100000:0.0:1789264249.137444:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+8:2403:x1876179311239680:12345-192.168.203.44@tcp:3:cat.0 Request processed in 1716us (1927us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789264249.137457:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 8 00002000:00100000:0.0:1789264249.137467:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9c3984641c00 x1876179311239680/t0(0) o3->92638a4f-1391-4305-a4ab-5961bcacc46a@192.168.203.44@tcp:330/0 lens 488/4536 e 0 to 0 dl 1789264260 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789264249.137477:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c3984641c00 with x1876179311239680 ext(0->4095) 00002000:00010000:0.0:1789264249.137482:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c3984641c00 00010000:00010000:1.0:1789264249.482920:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264250.377921:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322798976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789264250.378003:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264250.378092:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322798976 00000100:00100000:3.0:1789264250.378102:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322798976 00000100:00080000:1.0:1789264250.378164:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789264250.378186:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789264250.378203:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322798976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789264250.378231:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264250.378294:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322798976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264250.378303:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789264250.378316:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39844b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322799104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789264250.378333:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322798976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789264250.378363:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264250.378462:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322799104 00000100:00100000:3.0:1789264250.378467:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322799104 00000100:00080000:1.0:1789264250.378508:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789264250.378521:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789264250.378545:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322799104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789264250.378557:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264250.378587:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322799104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264250.378602:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789264250.378945:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39844b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322799104:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789264250.510154:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264250.890081:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39846bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322799232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789264250.890152:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264250.890273:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322799232 00000100:00100000:1.0:1789264250.890282:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322799232 00000100:00100000:1.0:1789264250.890344:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789264250.890363:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39844b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322799232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789264250.890396:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789264250.890443:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39844b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322799232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264250.890450:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789264250.890533:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39846bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322799232:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789264251.532242:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789264252.437870:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:1.0:1789264252.437883:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1789264252.440236:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000004:00080000:0.0:1789264252.440256:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00010000:00010000:1.0:1789264252.440285:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7c01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789264252.440301:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c3a8a0a1300 refcount 2 committed 0 result 0 batchid 8 00010000:00010000:1.0:1789264252.440304:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7c01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789264252.440306:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c3983c29900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c3a8a0a1240 00000020:00080000:0.0:1789264252.440313:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c3983c29700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c39826ca800 00010000:00010000:1.0:1789264252.440332:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7c01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789264252.440336:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1789264252.440357:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836ca200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264252.440364:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7c01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264252.440372:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7c01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264252.440392:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c39824a1400) 00010000:00010000:1.0:1789264252.440396:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789264252.440401:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7c01 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264252.440408:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca200/0xecaf9f2f14ed7c01 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789264252.440412:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1789264252.440483:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1789264252.440502:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322799360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789264252.440589:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264252.440656:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322799360 00000100:00100000:1.0:1789264252.440663:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322799360 00000100:00100000:1.0:1789264252.440737:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789264252.440763:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322799360:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789264252.440841:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1789264252.440880:0:11052:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789264252.440885:0:11052:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789264246 -> 1789264246 00002000:00010000:1.0:1789264252.440887:0:11052:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1789264245 -> 1789264245 00002000:00010000:1.0:1789264252.440889:0:11052:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789264246 -> 1789264246 00002000:00010000:1.0:1789264252.440892:0:11052:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789264252.440940:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3624:x1876179322799360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 194us (351us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789264252.440947:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789264252.441044:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1789264252.441049:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c3983fb6d80, transno 4294967323 00000004:00080000:0.0:1789264252.441068:0:3624:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1789264252.441092:0:3624:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c3984642d80 x1876179322799360/t4294967326(4294967326) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789264268 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789264252.441111:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c3984642d80/2, rc 0, transno 4294967326 00000100:00100000:0.0:1789264252.441117:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322799360:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789264252.557256:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264252.808829:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264252.808945:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311239808 00000100:00100000:1.0:1789264252.808955:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311239808 00000100:00080000:0.0:1789264252.809100:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264252.809173:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 254 00000100:00100000:1.0:1789264252.809185:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+18:12134:x1876179311239808:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789264252.809287:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+18:12134:x1876179311239808:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 Request processed in 105us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264252.809296:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 254 00000100:00100000:2.0:1789264252.813006:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264252.813131:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311239936 00000100:00100000:3.0:1789264252.813140:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311239936 00000100:00100000:3.0:1789264252.813208:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 255 00000100:00100000:3.0:1789264252.813221:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:12134:x1876179311239936:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789264252.813312:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:12134:x1876179311239936:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 Request processed in 97us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264252.813320:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 255 00000100:00080000:0.0:1789264252.813712:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789264252.816470:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264252.816660:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311240192 00000100:00100000:1.0:1789264252.816670:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311240192 00000100:00100000:1.0:1789264252.816729:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 65 00000100:00100000:1.0:1789264252.816740:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+18:12134:x1876179311240192:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789264252.817003:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+19:12134:x1876179311240192:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 265us (538us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789264252.817011:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 65 00000100:00100000:0.0:1789264252.938101:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789264252.938130:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322799488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789264252.938199:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264252.938273:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322799488 00000100:00100000:0.0:1789264252.938280:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322799488 00000100:00100000:0.0:1789264252.938352:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789264252.938362:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1876179322799488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789264252.938396:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789264252.938443:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1876179322799488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264252.938450:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789264252.938497:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322799488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789264252.939357:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322799744:0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.939416:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264252.939440:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398463ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322800256:0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.939461:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264252.939485:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322800768:0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.939506:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264252.939533:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789264252.939539:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322799616:0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.939565:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264252.939585:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398463a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322800128:0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.939609:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264252.939637:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322800640:0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.939661:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264252.939688:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322799616 00000100:00100000:2.0:1789264252.939693:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322799616 00000100:00100000:2.0:1789264252.939728:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789264252.939736:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3623:x1876179322799616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.939814:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3623:x1876179322799616:12345-0@lo:400:kworker.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264252.939821:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789264252.939851:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322799744 00000100:00100000:2.0:1789264252.939855:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322799744 00000100:00100000:2.0:1789264252.939878:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322800256 00000100:00100000:2.0:1789264252.939881:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322800256 00000100:00100000:2.0:1789264252.939902:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322800768 00000100:00100000:2.0:1789264252.939905:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322800768 00000100:00100000:2.0:1789264252.939919:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789264252.939925:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398463bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322799744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.939958:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398463bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322799744:12345-0@lo:400:kworker.0 Request processed in 34us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264252.939964:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789264252.939975:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789264252.939981:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322800256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.940006:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322800256:12345-0@lo:400:kworker.0 Request processed in 26us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264252.940013:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789264252.940024:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789264252.940030:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322800768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.940067:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322800768:12345-0@lo:400:kworker.0 Request processed in 38us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264252.940074:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789264252.940100:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322799872:0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.940310:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322800128 00000100:00100000:1.0:1789264252.940315:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322800128 00000100:00100000:1.0:1789264252.940364:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789264252.940371:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398463aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322800128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.940422:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398463aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322800128:12345-0@lo:400:kworker.0 Request processed in 52us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264252.940428:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789264252.940451:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322800000:0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.940478:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264252.940496:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398463b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322800512:0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.940516:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264252.940543:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398463b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322801024:0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.940565:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264252.940594:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322800000 00000100:00100000:1.0:1789264252.940598:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322800000 00000100:00100000:1.0:1789264252.940622:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789264252.940628:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322800000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.940661:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322800000:12345-0@lo:400:kworker.0 Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264252.940666:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789264252.940700:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322800000:0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.940761:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322800640 00000100:00100000:1.0:1789264252.940765:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322800640 00000100:00100000:1.0:1789264252.940792:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322800512 00000100:00100000:1.0:1789264252.940794:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322800512 00000100:00100000:1.0:1789264252.940818:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322801024 00000100:00100000:1.0:1789264252.940821:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322801024 00000100:00100000:1.0:1789264252.940838:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789264252.940844:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984639f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322800640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.940891:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984639f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322800640:12345-0@lo:400:kworker.0 Request processed in 47us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264252.940897:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789264252.940910:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789264252.940916:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322800512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.940945:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322800512:12345-0@lo:400:kworker.0 Request processed in 30us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264252.940951:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789264252.940961:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789264252.940974:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322801024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.941003:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322801024:12345-0@lo:400:kworker.0 Request processed in 30us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264252.941007:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789264252.941038:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398463b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322800512:0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.941046:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398463b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322801024:0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.941071:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322799616:0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.941081:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398463a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322800128:0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.941090:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322800640:0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.941099:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322799744:0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.942723:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264252.942965:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398463a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322800384:0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.942994:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264252.943013:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398463b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322800896:0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.943033:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264252.943073:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322800384 00000100:00100000:2.0:1789264252.943080:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322800384 00000100:00100000:2.0:1789264252.943120:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322800896 00000100:00100000:2.0:1789264252.943123:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322800896 00000100:00100000:2.0:1789264252.943145:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789264252.943153:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398463b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322800384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.943197:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398463b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322800384:12345-0@lo:400:kworker.0 Request processed in 45us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264252.943204:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789264252.943220:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789264252.943226:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322800896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264252.943326:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322799872 00000100:00100000:3.0:1789264252.943331:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322799872 00000100:00100000:1.0:1789264252.943375:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398463ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322800256:0@lo:400:kworker.0 00000100:00100000:3.0:1789264252.943387:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789264252.943397:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398463b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322799872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264252.943408:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322800768:0@lo:400:kworker.0 00000100:00100000:3.0:1789264252.943444:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398463b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322799872:12345-0@lo:400:kworker.0 Request processed in 48us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264252.943450:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789264252.943451:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789264252.943461:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322801152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789264252.943494:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264252.943519:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322800896:12345-0@lo:400:kworker.0 Request processed in 28us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264252.943526:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322799872:0@lo:400:kworker.0 00000100:00100000:2.0:1789264252.943530:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00080000:3.0:1789264252.943545:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398463a300 x1876179322800384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264252.943556:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398463a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322800384:0@lo:400:kworker.0 00010000:00080000:3.0:1789264252.943566:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398463b100 x1876179322800896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264252.943590:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398463b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322800896:0@lo:400:kworker.0 00000100:00100000:0.0:1789264252.943826:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322801152 00000100:00100000:0.0:1789264252.943831:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322801152 00000100:00100000:0.0:1789264252.943870:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789264252.943877:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322801152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789264252.943892:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789264252.943946:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322801152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264252.943952:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1789264252.943975:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789264252.943980:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789264252.943983:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789264252.943986:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264252.945085:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322801152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264253.079461:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264253.079540:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311240320 00000100:00100000:1.0:1789264253.079551:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311240320 00000100:00100000:1.0:1789264253.079629:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 256 00000100:00100000:1.0:1789264253.079640:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:12948:x1876179311240320:12345-192.168.203.44@tcp:101:lsof.0 00010000:00010000:1.0:1789264253.079658:0:7904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264253.079678:0:7904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed7c8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae49 expref: -99 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264253.079789:0:7904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7c94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264253.080257:0:7904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264253.080276:0:7904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264253.080327:0:7904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789264253.080330:0:7904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789264253.080364:0:7904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264253.080390:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed7c8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae49 expref: 7 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264253.080408:0:7904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7c94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae49 expref: 6 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264253.080417:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c398249eb00) 00010000:00010000:1.0:1789264253.080420:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789264253.080423:0:7904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44a00, rc 0) 00000100:00100000:1.0:1789264253.080948:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:12948:x1876179311240320:12345-192.168.203.44@tcp:101:lsof.0 Request processed in 851us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264253.080959:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 256 00000100:00080000:0.0:1789264253.081649:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264253.450029:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322801280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789264253.450103:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264253.450200:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322801280 00000100:00100000:3.0:1789264253.450209:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322801280 00000100:00100000:3.0:1789264253.450273:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789264253.450284:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322801280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789264253.450319:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789264253.450430:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322801280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264253.450438:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789264253.451611:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322801280:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789264253.577945:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264253.907810:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264253.907990:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264253.908029:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264253.908057:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264253.908076:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264253.908105:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264253.908131:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311240960 00000100:00100000:3.0:1789264253.908141:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311240960 00000100:00100000:3.0:1789264253.908208:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311240832 00000100:00100000:3.0:1789264253.908212:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311240832 00000100:00100000:3.0:1789264253.908239:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 111 00000100:00100000:3.0:1789264253.908253:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2402:x1876179311240960:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264253.908391:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 112 00000100:00100000:2.0:1789264253.908404:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311240832:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264253.908473:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311240832:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 72us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264253.908481:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 112 00000100:00100000:2.0:1789264253.908505:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311240704 00000100:00100000:2.0:1789264253.908509:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311240704 00000100:00100000:2.0:1789264253.908535:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311240576 00000100:00100000:2.0:1789264253.908538:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311240576 00000100:00100000:2.0:1789264253.908555:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311241088 00000100:00100000:2.0:1789264253.908558:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311241088 00000100:00100000:2.0:1789264253.908576:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 262 00000100:00100000:2.0:1789264253.908582:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311240704:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264253.908611:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2402:x1876179311240704:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 29us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264253.908618:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 262 00000100:00100000:2.0:1789264253.908633:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 263 00000100:00100000:2.0:1789264253.908640:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+19:2402:x1876179311240576:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264253.908671:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+19:2402:x1876179311240576:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 31us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264253.908677:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 263 00000100:00100000:2.0:1789264253.908696:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 264 00000100:00100000:2.0:1789264253.908703:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311241088:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264253.908726:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2402:x1876179311241088:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264253.908732:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 264 00000100:00100000:3.0:1789264253.909138:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2402:x1876179311240960:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 889us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264253.909145:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 111 00000100:00080000:3.0:1789264253.909177:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789264253.909503:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789264253.909506:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789264253.911389:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311240448 00000100:00100000:0.0:1789264253.911402:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311240448 00000100:00100000:0.0:1789264253.911468:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 373 00000100:00100000:0.0:1789264253.911478:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2402:x1876179311240448:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264253.911611:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2402:x1876179311240448:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 133us (3809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264253.911633:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 373 00010000:00010000:1.0:1789264254.601966:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264255.498214:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322801408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789264255.498293:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264255.498411:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322801408 00000100:00100000:3.0:1789264255.498418:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322801408 00000100:00100000:3.0:1789264255.498474:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789264255.498488:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398463b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322801408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789264255.498513:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264255.498568:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398463b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322801408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264255.498575:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1789264255.498679:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789264255.498714:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322801408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789264255.504720:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789264255.504767:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398463a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322801536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789264255.504834:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264255.504989:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322801536 00000100:00100000:3.0:1789264255.504997:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322801536 00000100:00100000:3.0:1789264255.505074:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789264255.505085:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322801536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789264255.505107:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789264255.505155:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322801536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264255.505161:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789264255.505204:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398463a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322801536:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789264255.505276:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789264255.626425:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789264255.690595:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789264255.757164:0:13760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789264255.757174:0:13760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789264255.757256:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1789264255.757264:0:13760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:1.0:1789264255.779697:0:15017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:50:54 (1789264254) 00000100:00100000:0.0:1789264256.011695:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39846bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322801664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789264256.011891:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264256.014109:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322801664 00000100:00100000:0.0:1789264256.014120:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322801664 00000100:00100000:0.0:1789264256.014177:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789264256.014187:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322801664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789264256.014222:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789264256.014302:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322801664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264256.014309:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789264256.014368:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39846bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322801664:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789264256.649899:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264257.676076:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264258.059596:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322801792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789264258.059661:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264258.059815:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322801792 00000100:00100000:3.0:1789264258.059823:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322801792 00000100:00100000:3.0:1789264258.059882:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789264258.059910:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322801792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789264258.059936:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789264258.059977:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322801792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264258.059984:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789264258.060069:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322801792:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789264258.060179:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789264258.063883:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39846be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322802048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264258.063956:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264258.063976:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322802304:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.064012:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322802560:0@lo:400:kworker.0 00000100:00100000:0.0:1789264258.064018:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264258.064049:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1876179322802816:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.064050:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264258.064079:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322803072:0@lo:400:kworker.0 00000100:00100000:0.0:1789264258.064091:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264258.064111:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264258.064122:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322803328:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.064139:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789264258.064148:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322801920:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.064178:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264258.064204:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322802432:0@lo:400:kworker.0 00000100:00100000:0.0:1789264258.064205:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264258.064234:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789264258.064237:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264258.064255:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322802176:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.064259:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322802944:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.064296:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264258.064324:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322803456:0@lo:400:kworker.0 00000100:00100000:0.0:1789264258.064324:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264258.064354:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322802688:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.064368:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264258.064388:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264258.064409:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322802048 00000100:00100000:0.0:1789264258.064413:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322803200:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.064418:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322802048 00000100:00100000:0.0:1789264258.064449:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264258.064478:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322802816 00000100:00100000:1.0:1789264258.064479:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789264258.064484:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322802816 00000100:00100000:1.0:1789264258.064492:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1876179322802048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789264258.064514:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00002000:00000024:1.0:1789264258.064515:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789264258.064526:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab5573850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1876179322802816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.064565:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1876179322802048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264258.064574:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789264258.064581:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab5573850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1876179322802816:12345-0@lo:400:kworker.0 Request processed in 57us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264258.064590:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789264258.064599:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322802304 00000100:00100000:1.0:1789264258.064604:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322802304 00000100:00100000:1.0:1789264258.064628:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322802560 00000100:00100000:1.0:1789264258.064631:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322802560 00000100:00100000:1.0:1789264258.064645:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789264258.064650:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322802304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.064690:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322802304:12345-0@lo:400:kworker.0 Request processed in 38us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264258.064697:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789264258.064717:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789264258.064724:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322802560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.064786:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322802560:12345-0@lo:400:kworker.0 Request processed in 62us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264258.064793:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789264258.064821:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322803072 00000100:00100000:1.0:1789264258.064825:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322803072 00000100:00100000:1.0:1789264258.064853:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322802944 00000100:00100000:1.0:1789264258.064857:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322802944 00000100:00100000:1.0:1789264258.064886:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322803456 00000100:00100000:1.0:1789264258.064897:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322803456 00000100:00100000:1.0:1789264258.064921:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789264258.064929:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322803072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.064966:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322803072:12345-0@lo:400:kworker.0 Request processed in 37us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264258.064974:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789264258.064993:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789264258.065001:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322802944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.065038:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322802944:12345-0@lo:400:kworker.0 Request processed in 38us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264258.065045:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789264258.065063:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789264258.065071:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3625:x1876179322803456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.065104:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3625:x1876179322803456:12345-0@lo:400:kworker.0 Request processed in 34us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264258.065111:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789264258.065138:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322801920 00000100:00100000:1.0:1789264258.065142:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322801920 00000100:00100000:1.0:1789264258.065174:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789264258.065183:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3625:x1876179322801920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.065223:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3625:x1876179322801920:12345-0@lo:400:kworker.0 Request processed in 41us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264258.065230:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789264258.065268:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322803328 00000100:00100000:1.0:1789264258.065272:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322803328 00000100:00100000:1.0:1789264258.065294:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322802432 00000100:00100000:1.0:1789264258.065298:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322802432 00000100:00100000:1.0:1789264258.065337:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322802176 00000100:00100000:1.0:1789264258.065341:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322802176 00000100:00100000:1.0:1789264258.065354:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322802688 00000100:00100000:1.0:1789264258.065357:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322802688 00000100:00100000:1.0:1789264258.065376:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322803200 00000100:00100000:1.0:1789264258.065378:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322803200 00000100:00100000:1.0:1789264258.065402:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789264258.065409:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1876179322803328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.065450:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1876179322803328:12345-0@lo:400:kworker.0 Request processed in 42us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264258.065457:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789264258.065476:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789264258.065484:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39846bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322802432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.065517:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39846bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322802432:12345-0@lo:400:kworker.0 Request processed in 34us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264258.065523:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789264258.065541:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789264258.065550:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322802176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.065584:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322802176:12345-0@lo:400:kworker.0 Request processed in 35us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264258.065590:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789264258.065607:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789264258.065615:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322802688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.065652:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322802688:12345-0@lo:400:kworker.0 Request processed in 38us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264258.065658:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789264258.065674:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789264258.065689:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322803200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.065726:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322803200:12345-0@lo:400:kworker.0 Request processed in 39us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264258.065733:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789264258.065800:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322801920:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.065819:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322802432:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.065836:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322802944:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.065851:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322803456:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.065866:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322802560:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.065897:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322803072:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.065921:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39846be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322802048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264258.066014:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322802176:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.066031:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322802688:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.066050:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322803200:0@lo:400:kworker.0 00000100:00100000:1.0:1789264258.066074:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322802304:0@lo:400:kworker.0 00010000:00080000:1.0:1789264258.066092:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983fb7480 x1876179322802816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264258.066102:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1876179322802816:0@lo:400:kworker.0 00010000:00080000:1.0:1789264258.066118:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983fb5f80 x1876179322803328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264258.066139:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322803328:0@lo:400:kworker.0 00000100:00080000:2.0:1789264258.066373:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789264258.066379:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789264258.066381:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789264258.066383:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789264258.570335:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789264258.570366:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322803584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789264258.570433:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264258.570854:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322803584 00000100:00100000:3.0:1789264258.570863:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322803584 00000100:00100000:3.0:1789264258.570929:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789264258.570939:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322803584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789264258.570973:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789264258.571032:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322803584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264258.571040:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789264258.571102:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322803584:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1789264258.571388:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967326 is committed 00000001:00080000:1.0:1789264258.571829:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1789264258.571837:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789264258.571912:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789264258.571923:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789264258.698765:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264258.759129:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264258.759237:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311241344 00000100:00100000:1.0:1789264258.759248:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311241344 00000100:00100000:3.0:1789264258.760041:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:3.0:1789264258.760063:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398463ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+18:13171:x1876179311241344:12345-192.168.203.44@tcp:35:umount.0 00000100:00080000:2.0:1789264258.760179:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789264258.760590:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398463ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+19:13171:x1876179311241344:12345-192.168.203.44@tcp:35:umount.0 Request processed in 537us (1518us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789264258.760599:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:3.0:1789264258.763507:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264258.763924:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311241600 00000100:00100000:1.0:1789264258.763933:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311241600 00000100:00100000:1.0:1789264258.763988:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:1.0:1789264258.763999:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+19:13171:x1876179311241600:12345-192.168.203.44@tcp:35:umount.0 00000100:00100000:1.0:1789264258.764925:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+20:13171:x1876179311241600:12345-192.168.203.44@tcp:35:umount.0 Request processed in 923us (1423us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789264258.764936:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:2.0:1789264258.767433:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264258.767538:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311241856 00000100:00100000:3.0:1789264258.767548:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311241856 00000100:00100000:3.0:1789264258.767606:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:3.0:1789264258.767618:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab27a6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+20:13171:x1876179311241856:12345-192.168.203.44@tcp:35:umount.0 00000100:00100000:3.0:1789264258.767958:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab27a6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+21:13171:x1876179311241856:12345-192.168.203.44@tcp:35:umount.0 Request processed in 333us (525us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789264258.767981:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:2.0:1789264258.772998:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264258.773197:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311242112 00000100:00100000:1.0:1789264258.773207:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311242112 00000100:00100000:1.0:1789264258.773274:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:1.0:1789264258.773285:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+21:13171:x1876179311242112:12345-192.168.203.44@tcp:35:umount.0 00000100:00100000:1.0:1789264258.774119:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92638a4f-1391-4305-a4ab-5961bcacc46a+22:13171:x1876179311242112:12345-192.168.203.44@tcp:35:umount.0 Request processed in 830us (1123us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789264258.774131:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:2.0:1789264258.780536:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264258.780571:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264258.780638:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264258.781380:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311242240 00000100:00100000:0.0:1789264258.781397:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311242240 00000100:00100000:1.0:1789264258.782026:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311242496 00000100:00100000:1.0:1789264258.782202:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311242496 00000100:00100000:1.0:1789264258.782271:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311242368 00000100:00100000:1.0:1789264258.782275:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311242368 00000100:00100000:1.0:1789264258.782648:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:1.0:1789264258.782662:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398463a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+15:2402:x1876179311242496:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264258.782697:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264258.782718:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5623c00/0xecaf9f2f14ed6e7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa75 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264258.782736:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264258.782825:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398463a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+14:2402:x1876179311242496:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 166us (2252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264258.782832:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:1.0:1789264258.782851:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:1.0:1789264258.782857:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984638e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+13:2402:x1876179311242368:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264258.782867:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264258.782893:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5623a00/0xecaf9f2f14ed6bae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda95d expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264258.782901:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264258.782919:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984638e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:2402:x1876179311242368:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 62us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264258.782925:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:0.0:1789264258.783066:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:0.0:1789264258.783077:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984639880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:2402:x1876179311242240:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264258.783086:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264258.783097:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5623e00/0xecaf9f2f14ed6bed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda99c expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264258.783107:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264258.783130:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984639880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2402:x1876179311242240:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 56us (2606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264258.783137:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:2.0:1789264258.787624:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264258.787840:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311242880 00000100:00100000:3.0:1789264258.787850:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311242880 00000100:00100000:3.0:1789264258.787931:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 81 00000100:00100000:3.0:1789264258.787942:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398463ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+7:2401:x1876179311242880:12345-192.168.203.44@tcp:9:umount.0 00000020:00000080:3.0:1789264258.787972:0:10317:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed71f8 00000020:00010000:3.0:1789264258.787978:0:10317:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c3983cea000: total 0 00000100:00080000:3.0:1789264258.787983:0:10317:0:(import.c:65:import_set_state_nolock()) ffff9c3983ce9800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1789264258.788034:0:6479:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c3983cea000: total 0 00000001:00000004:3.0:1789264258.788035:0:10317:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00010000:00010000:1.0:1789264258.788089:0:6479:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c3983cea000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789264258.788150:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099ae7558/0xecaf9f2f14ed75b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac5f expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264258.788189:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003531cad7/0xecaf9f2f14ed7c86 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae42 expref: 4 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264258.788215:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398463ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+4:2401:x1876179311242880:12345-192.168.203.44@tcp:9:umount.0 Request processed in 274us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264258.788226:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 81 00010000:00010000:1.0:1789264258.788229:0:6479:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c3983cea000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789264258.788248:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264258.788250:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264258.788252:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789264258.788345:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789264258.794210:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264258.794316:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311243008 00000100:00100000:0.0:1789264258.794326:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311243008 00000100:00080000:2.0:1789264258.794445:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264258.794712:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 82 00000100:00100000:0.0:1789264258.794724:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2401:x1876179311243008:12345-192.168.203.44@tcp:9:umount.0 00000020:00000080:0.0:1789264258.794805:0:8406:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6f89 00000100:00080000:0.0:1789264258.794822:0:8406:0:(import.c:65:import_set_state_nolock()) ffff9c3a88d17000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789264258.794867:0:8406:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789264258.795034:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92638a4f-1391-4305-a4ab-5961bcacc46a+2:2401:x1876179311243008:12345-192.168.203.44@tcp:9:umount.0 Request processed in 310us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264258.795041:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 82 00010000:00010000:1.0:1789264258.795111:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264258.808814:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264258.811492:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311244032 00000100:00100000:1.0:1789264258.811508:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311244032 00000100:00100000:1.0:1789264258.811974:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 257 00000100:00100000:1.0:1789264258.811988:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+22:2401:x1876179311244032:12345-192.168.203.44@tcp:39:umount.0 00000020:00000080:1.0:1789264258.812020:0:7904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6bbc 00000020:00010000:1.0:1789264258.812036:0:7904:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c39833d5000: total 0 00000100:00080000:1.0:1789264258.812041:0:7904:0:(import.c:65:import_set_state_nolock()) ffff9c39833d7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789264258.812078:0:7904:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:3.0:1789264258.812172:0:6478:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c39833d5000: total 0 00010000:00010000:3.0:1789264258.812233:0:6478:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c39833d5000, canceled 0 locks, left on hash table 13. 00000100:00100000:1.0:1789264258.812248:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92638a4f-1391-4305-a4ab-5961bcacc46a+21:2401:x1876179311244032:12345-192.168.203.44@tcp:39:umount.0 Request processed in 263us (3443us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1789264258.812257:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 257 00010000:00010000:3.0:1789264258.812280:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:3.0:1789264258.812285:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789264258.812294:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36a000/0xecaf9f2f14ed7929 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdad5b expref: 20 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264258.812325:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:3.0:1789264258.812327:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789264258.812331:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a8a36b800/0xecaf9f2f14ed7c47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae2d expref: 19 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264258.812342:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:3.0:1789264258.812345:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789264258.812362:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836ca600/0xecaf9f2f14ed7c71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae3b expref: 18 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264258.812378:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:3.0:1789264258.812381:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789264258.812384:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5622e00/0xecaf9f2f14ed6f5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa9f expref: 17 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264258.812397:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:3.0:1789264258.812399:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789264258.812403:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1ca00/0xecaf9f2f14ed7578 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac4a expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264258.812411:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:3.0:1789264258.812414:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789264258.812416:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed75a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac58 expref: 15 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264258.812427:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c398249eb00) 00010000:00010000:3.0:1789264258.812429:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789264258.812432:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed7620 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac7b expref: 14 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264258.812442:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e7c300) 00010000:00010000:3.0:1789264258.812444:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264258.812448:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3ab5623000/0xecaf9f2f14ed6f04 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa8a expref: 13 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264258.812463:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c39824a1e00) 00010000:00010000:3.0:1789264258.812471:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789264258.812476:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cbe00/0xecaf9f2f14ed7b67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdadf5 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264258.812491:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c3983364100) 00010000:00010000:3.0:1789264258.812493:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789264258.812496:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366be00/0xecaf9f2f14ed725a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdab78 expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264258.812510:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c39824a1300) 00010000:00010000:3.0:1789264258.812512:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789264258.812515:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b800/0xecaf9f2f14ed6ee8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa83 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264258.812528:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c398249e000) 00010000:00010000:3.0:1789264258.812530:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789264258.812533:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed763c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac82 expref: 9 pid: 9197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264258.812544:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c3983364000) 00010000:00010000:3.0:1789264258.812546:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789264258.812548:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a200/0xecaf9f2f14ed7498 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdac12 expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264258.812558:0:6478:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c39833d5000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789264258.812574:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264258.812577:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264258.812578:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264258.826632:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264258.826737:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311244160 00000100:00100000:0.0:1789264258.826788:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311244160 00000100:00100000:0.0:1789264258.826859:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 258 00000100:00100000:0.0:1789264258.826868:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398463bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+5:2401:x1876179311244160:12345-192.168.203.44@tcp:39:umount.0 00000100:00080000:2.0:1789264258.826969:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:0.0:1789264258.827042:0:6491:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6bc3 00000100:00080000:0.0:1789264258.827058:0:6491:0:(import.c:65:import_set_state_nolock()) ffff9c3abf686800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789264258.827078:0:6491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1789264258.827314:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264258.827359:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398463bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92638a4f-1391-4305-a4ab-5961bcacc46a+3:2401:x1876179311244160:12345-192.168.203.44@tcp:39:umount.0 Request processed in 491us (735us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789264258.827367:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 258 00000100:00100000:2.0:1789264259.021325:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264259.021373:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264259.021406:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264259.021506:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311244416 00000100:00100000:1.0:1789264259.021515:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311244416 00000100:00100000:1.0:1789264259.021578:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311244544 00000100:00100000:1.0:1789264259.021582:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311244544 00000100:00100000:1.0:1789264259.021608:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 271 00000100:00100000:1.0:1789264259.021617:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2404:x1876179311244416:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264259.021687:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2404:x1876179311244416:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 70us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264259.021695:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 271 00000100:00100000:1.0:1789264259.021727:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 272 00000100:00100000:1.0:1789264259.021734:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311244544:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264259.021787:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2405:x1876179311244544:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 53us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264259.021794:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 272 00000100:00080000:2.0:1789264259.021865:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789264259.021869:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789264259.021902:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311244288 00000100:00100000:0.0:1789264259.021908:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311244288 00000100:00100000:0.0:1789264259.021950:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 375 00000100:00100000:0.0:1789264259.021959:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2405:x1876179311244288:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264259.021991:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2405:x1876179311244288:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 33us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264259.021998:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 375 00010000:00010000:1.0:1789264259.721962:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264260.203447:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264260.203489:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264260.203627:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264260.208338:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311244672 00000100:00100000:0.0:1789264260.208353:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311244672 00000100:00100000:0.0:1789264260.208420:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311244928 00000100:00100000:0.0:1789264260.208424:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311244928 00000100:00100000:0.0:1789264260.208463:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311244800 00000100:00100000:0.0:1789264260.208466:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311244800 00000100:00100000:0.0:1789264260.208727:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:0.0:1789264260.208740:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+12:2404:x1876179311244672:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264260.208785:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264260.208804:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f094200/0xecaf9f2f14ed6cbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9b1 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264260.208822:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264260.208884:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+11:2404:x1876179311244672:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 148us (5446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264260.208891:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:0.0:1789264260.209068:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:0.0:1789264260.209077:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398463b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+10:2404:x1876179311244928:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264260.209085:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264260.209095:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c398366aa00/0xecaf9f2f14ed6e78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaa6e expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264260.209104:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264260.209124:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398463b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+9:2404:x1876179311244928:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 49us (5634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264260.209131:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:0.0:1789264260.209145:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:0.0:1789264260.209151:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984639c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+8:2404:x1876179311244800:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789264260.209158:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264260.209167:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f095200/0xecaf9f2f14ed6cc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9e2 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264260.209184:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264260.209203:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984639c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+7:2404:x1876179311244800:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 52us (5577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264260.209209:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:2.0:1789264260.209912:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264260.210025:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311245184 00000100:00100000:0.0:1789264260.210032:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311245184 00000100:00100000:0.0:1789264260.210080:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 259 00000100:00100000:0.0:1789264260.210088:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398463a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+6:2401:x1876179311245184:12345-192.168.203.44@tcp:39:umount.0 00000020:00000080:0.0:1789264260.210118:0:6491:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6cd4 00000020:00010000:0.0:1789264260.210127:0:6491:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c3abf630000: total 0 00000100:00080000:0.0:1789264260.210131:0:6491:0:(import.c:65:import_set_state_nolock()) ffff9c3abf630800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789264260.210152:0:6491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1789264260.210301:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398463a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2401:x1876179311245184:12345-192.168.203.44@tcp:39:umount.0 Request processed in 201us (379us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1789264260.210308:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 259 00000020:00010000:2.0:1789264260.210894:0:6478:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c3abf630000: total 0 00010000:00010000:2.0:1789264260.210899:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264260.210953:0:6478:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c3abf630000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789264260.210984:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c398249eb00) 00010000:00010000:2.0:1789264260.210987:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789264260.210994:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed7c94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae49 expref: 4 pid: 7904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264260.211012:0:6478:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c3abf630000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789264260.211022:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264260.211023:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264260.211025:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264260.220825:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264260.220912:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311245312 00000100:00100000:1.0:1789264260.220927:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311245312 00000100:00100000:1.0:1789264260.220993:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 260 00000100:00100000:1.0:1789264260.221005:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+5:2401:x1876179311245312:12345-192.168.203.44@tcp:39:umount.0 00000020:00000080:1.0:1789264260.221045:0:6492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6cdb 00000100:00080000:1.0:1789264260.221054:0:6492:0:(import.c:65:import_set_state_nolock()) ffff9c3abf637000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789264260.221226:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789264260.221404:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7381f06c-fe63-4f19-bfe0-7d6bc17e625e+3:2401:x1876179311245312:12345-192.168.203.44@tcp:39:umount.0 Request processed in 399us (587us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789264260.221413:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 260 00010000:00010000:2.0:1789264260.222128:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264260.264966:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264260.265796:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311245568 00000100:00100000:1.0:1789264260.265808:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311245568 00000100:00100000:1.0:1789264260.265860:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 376 00000100:00100000:1.0:1789264260.265870:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+7:2401:x1876179311245568:12345-192.168.203.44@tcp:251:umount.0 00000020:00000080:1.0:1789264260.265914:0:6482:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6b99 00000020:00010000:1.0:1789264260.265922:0:6482:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c3abf680000: total 0 00000100:00080000:1.0:1789264260.265927:0:6482:0:(import.c:65:import_set_state_nolock()) ffff9c3abf687800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789264260.266013:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee+3:2401:x1876179311245568:12345-192.168.203.44@tcp:251:umount.0 Request processed in 144us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264260.266021:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 376 00000020:00010000:2.0:1789264260.266864:0:7431:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c3abf680000: total 0 00010000:00010000:2.0:1789264260.266915:0:7431:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c3abf680000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789264260.266950:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36ba00/0xecaf9f2f14ed6bf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bda9a3 expref: 2 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264260.266983:0:7431:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c3abf680000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789264260.266995:0:7431:0:(genops.c:885:class_export_put()) final put ffff9c3abf680000/a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee 00010000:00010000:2.0:1789264260.267015:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264260.267018:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264260.267019:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789264260.267057:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3abf680000/a4d2f54e-cc34-4a42-9d8c-32c1a6fa90ee for MGS 00000020:00000080:0.0:1789264260.267091:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3abf687800 for MGS 00000100:00100000:1.0:1789264260.618890:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789264260.618914:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398463a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322803712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789264260.618991:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264260.619390:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322803712 00000100:00100000:2.0:1789264260.619398:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322803712 00000100:00100000:2.0:1789264260.619467:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789264260.619478:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322803712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789264260.619516:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264260.619568:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322803712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264260.619575:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789264260.619619:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398463a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322803712:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789264260.619730:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264260.622525:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789264260.622547:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398463a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322803840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789264260.622606:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264260.622718:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322803840 00000100:00100000:2.0:1789264260.622724:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322803840 00000100:00100000:2.0:1789264260.622807:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789264260.622815:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322803840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789264260.622835:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264260.622878:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322803840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264260.622885:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789264260.622930:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398463a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322803840:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789264260.623002:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789264260.749194:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264261.130853:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789264261.130875:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322803968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789264261.130952:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264261.131014:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322803968 00000100:00100000:1.0:1789264261.131021:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322803968 00000100:00100000:1.0:1789264261.131070:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789264261.131079:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322803968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789264261.131110:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789264261.131154:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322803968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264261.131162:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789264261.131204:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322803968:0@lo:41:osp-pre-0-1.0 00000020:01000004:0.0:1789264261.568538:0:15214:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789264261.578900:0:15214:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789264261.578964:0:15214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.578980:0:15214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.578988:0:15214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.578995:0:15214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.579137:0:15214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789264261.579142:0:15214:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1789264261.579147:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264261.579156:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264261.579171:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a80031200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264261.579174:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789264261.579175:0:15214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789264261.579182:0:15214:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1789264261.579187:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789264261.579189:0:15214:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:2.0:1789264261.579198:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264261.579203:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789264261.579206:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789264261.579209:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:1.0:1789264261.579216:0:15214:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa7e6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789264261.579236:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264261.579243:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789264261.579269:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264261.579276:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a80031200/0xecaf9f2f14ed6c4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6c56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264261.579397:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398463a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322804224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264261.579457:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789264261.579561:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264261.579563:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264261.579565:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264261.580877:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876179322804096:0@lo:39:umount.0 00000100:00100000:1.0:1789264261.580928:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264261.581112:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322804096 00000100:00100000:3.0:1789264261.581135:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322804096 00000100:00100000:3.0:1789264261.581205:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789264261.581215:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876179322804096:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789264261.581243:0:6490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed67b0 00000100:00080000:3.0:1789264261.581252:0:6490:0:(import.c:65:import_set_state_nolock()) ffff9c3aae158000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789264261.581333:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3621:x1876179322804096:12345-0@lo:39:umount.0 Request processed in 119us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264261.581340:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:3.0:1789264261.581349:0:6490:0:(genops.c:885:class_export_put()) final put ffff9c3aae15c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789264261.581373:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aae15c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789264261.581549:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3aae158000 for lustre-MDT0000 00000100:00080000:3.0:1789264261.581581:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa7e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789264261.581594:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876179322804096:0@lo:39:umount.0 00000100:00100000:0.0:1789264261.581825:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322804224 00000100:00100000:0.0:1789264261.581832:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322804224 00000100:00080000:1.0:1789264261.581847:0:15214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789264261.581852:0:15214:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789264261.581857:0:15214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1789264261.581884:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789264261.581893:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3625:x1876179322804224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264261.581905:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264261.581933:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264261.581965:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f095e00/0xecaf9f2f14ed6c56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c4f expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.582165:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264261.582221:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+23:3625:x1876179322804224:12345-0@lo:103:ldlm_bl.0 Request processed in 329us (2763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264261.582229:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789264261.582497:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398463a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322804224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789264261.583159:0:15214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.583173:0:15214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.583181:0:15214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.583188:0:15214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.583211:0:15214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789264261.583217:0:15214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.583234:0:15214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.583241:0:15214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.583248:0:15214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.583263:0:15214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789264261.583269:0:15214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.583276:0:15214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.583292:0:15214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.583299:0:15214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584215:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789264261.584224:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584233:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a80031000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264261.584237:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584247:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264261.584255:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264261.584261:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789264261.584264:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789264261.584308:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584315:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264261.584350:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584357:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a80031000/0xecaf9f2f14ed6c5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6c64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584371:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789264261.584374:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584380:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8f094c00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264261.584383:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584390:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264261.584396:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264261.584401:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789264261.584404:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789264261.584406:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789264261.584420:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584427:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264261.584432:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584439:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094c00/0xecaf9f2f14ed6b53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6b5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584459:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264261.584462:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584468:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366a800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264261.584470:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584477:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264261.584551:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264261.584556:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789264261.584559:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789264261.584573:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584579:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264261.584597:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.584605:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264261.584606:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264261.584608:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264261.584610:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264261.584625:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322804352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789264261.584668:0:15214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789264261.584676:0:15214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed6eb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6eb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264261.584684:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789264261.584691:0:15214:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789264261.584701:0:15214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ac216c800/0xecaf9f2f14ed670f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.584717:0:15214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ac216c800/0xecaf9f2f14ed670f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.584724:0:15214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ac216c800/0xecaf9f2f14ed670f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264261.584731:0:15214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3ac216c800/0xecaf9f2f14ed670f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264261.584732:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789264261.584761:0:15214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789264261.584765:0:15214:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789264261.584769:0:15214:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1789264261.584807:0:15214:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789264261.584811:0:15214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789264261.584816:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789264261.584822:0:15214:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000100:00100000:0.0:1789264261.584826:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322804480:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1789264261.584828:0:15214:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c3983122000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789264261.584837:0:15214:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c39820db000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789264261.584842:0:15214:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c3ab7f50800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789264261.584847:0:15214:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c3ab7dea800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1789264261.584854:0:15214:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9c3abf630000 7381f06c-fe63-4f19-bfe0-7d6bc17e625e 192.168.203.44@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:0.0:1789264261.584860:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789264261.584868:0:15214:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9c39833d5000 92638a4f-1391-4305-a4ab-5961bcacc46a 192.168.203.44@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1789264261.584874:0:15214:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9c3ab3028000) has exports, disconnecting them 00000020:00080000:1.0:1789264261.584880:0:15214:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c3983122000), last request at 1789264258 00000020:00000080:1.0:1789264261.584886:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6ac0 00000100:00100000:0.0:1789264261.584901:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322804608:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789264261.584908:0:15214:0:(import.c:65:import_set_state_nolock()) ffff9c3983121800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789264261.584924:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789264261.584956:0:15214:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c3983122000): rc 0 00000020:00000080:1.0:1789264261.584959:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3983122000/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:0.0:1789264261.584963:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322804352 00000020:00080000:1.0:1789264261.584969:0:15214:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c39820db000), last request at 1789264258 00000100:00100000:0.0:1789264261.584971:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322804352 00000020:00000080:1.0:1789264261.584973:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed699a 00000100:00080000:1.0:1789264261.584981:0:15214:0:(import.c:65:import_set_state_nolock()) ffff9c39820dd000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789264261.584993:0:15214:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c39820db000): rc 0 00000020:00000080:1.0:1789264261.584995:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c39820db000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1789264261.585000:0:15214:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c3ab7f50800), last request at 1789264091 00000020:00000080:1.0:1789264261.585003:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6897 00000100:00080000:1.0:1789264261.585006:0:15214:0:(import.c:65:import_set_state_nolock()) ffff9c3ab7f57000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789264261.585012:0:15214:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c3ab7f50800): rc 0 00000020:00000080:1.0:1789264261.585013:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3ab7f50800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1789264261.585017:0:15214:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c3ab7dea800), last request at 1789264091 00000020:00000080:1.0:1789264261.585020:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6866 00000100:00080000:1.0:1789264261.585023:0:15214:0:(import.c:65:import_set_state_nolock()) ffff9c3aae103000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789264261.585028:0:15214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1789264261.585093:0:15214:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c3ab7dea800): rc 0 00000004:00000080:1.0:1789264261.585098:0:15214:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb65101b3bae0 00000100:00080000:1.0:1789264261.585115:0:15214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789264261.585118:0:15214:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1789264261.585128:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322804480 00000100:00100000:0.0:1789264261.585134:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322804480 00000100:00100000:0.0:1789264261.585158:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322804608 00000100:00100000:0.0:1789264261.585161:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322804608 00000100:00100000:0.0:1789264261.585177:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789264261.585185:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+25:3622:x1876179322804352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264261.585197:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264261.585210:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5623800/0xecaf9f2f14ed6c64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c5d expref: 25 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.585222:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264261.585250:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789264261.585259:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322804352:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264261.585267:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+24:3622:x1876179322804480:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264261.585268:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1789264261.585291:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264261.585304:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36ae00/0xecaf9f2f14ed6b5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b53 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264261.585305:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789264261.585316:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+22:3624:x1876179322804608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789264261.585318:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264261.585328:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264261.585339:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c398366a400/0xecaf9f2f14ed6eb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6eb0 expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.585350:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264261.585354:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+21:3622:x1876179322804480:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264261.585362:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1789264261.585384:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789264261.585385:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:3624:x1876179322804608:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (460us total) trans 0 rc 0/0 00010000:00010000:3.0:1789264261.585395:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ac216c800/0xecaf9f2f14ed670f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264261.585407:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1789264261.585408:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ac216c800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1789264261.585413:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ac216c800/0xecaf9f2f14ed670f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264261.585422:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ac216c800/0xecaf9f2f14ed670f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789264261.585429:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ac216c800/0xecaf9f2f14ed670f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264261.585435:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789264261.585438:0:7431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789264261.585440:0:7431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:0.0:1789264261.585455:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322804608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789264261.585460:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3ac216c800/0xecaf9f2f14ed670f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264261.585467:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789264261.585474:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789264261.585476:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ac216c800/0xecaf9f2f14ed670f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264261.585485:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ac216c800/0xecaf9f2f14ed670f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6716 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264261.585495:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264261.585496:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264261.585498:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789264261.585509:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3983122000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789264261.585545:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c39820db000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1789264261.585551:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322804736:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1789264261.585575:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ab7f50800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1789264261.585584:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1789264261.585605:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3983121800 for lustre-MDT0000 00000020:00000080:3.0:1789264261.585612:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c39820dd000 for lustre-MDT0000 00000100:00100000:0.0:1789264261.585615:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322804736 00000020:00000080:3.0:1789264261.585617:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3ab7f57000 for lustre-MDT0000 00000100:00100000:0.0:1789264261.585620:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322804736 00000100:00100000:0.0:1789264261.585651:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789264261.585659:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab2ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+20:3624:x1876179322804736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264261.585667:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264261.585676:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a813fd800/0xecaf9f2f14ed6716 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed670f expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264261.585685:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264261.585721:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab2ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:3624:x1876179322804736:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264261.585727:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789264261.585850:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322804480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264261.585859:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322804352:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264261.585876:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789264261.586485:0:15214:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789264261.586502:0:15214:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa1fb000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789264261.586652:0:15214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789264261.586656:0:15214:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1789264261.586672:0:15214:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789264261.586724:0:15214:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789264261.586732:0:15214:0:(import.c:65:import_set_state_nolock()) ffff9c3abaa51000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789264261.586737:0:15214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789264261.586769:0:15214:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000100:00100000:1.0:1789264261.586777:0:15214:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c3984642d80 x1876179322799360/t4294967326(4294967326) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789264268 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789264261.586785:0:15214:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c3984642d80, transno 4294967326 00000004:00080000:1.0:1789264261.586797:0:15214:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789264261.586875:0:15214:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789264261.586883:0:15214:0:(import.c:65:import_set_state_nolock()) ffff9c39833d4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789264261.586937:0:15214:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c3ab3028000) has no exports 00000100:00100000:3.0:1789264261.587022:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322804736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264261.587161:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322804864:0@lo:39:umount.0 00000100:00100000:0.0:1789264261.587208:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264261.587231:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322804992:0@lo:9:umount.0 00000100:00100000:0.0:1789264261.587252:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264261.587292:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322805120:0@lo:9:umount.0 00000100:00100000:0.0:1789264261.587315:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264261.587347:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322804864 00000100:00100000:0.0:1789264261.587352:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322804864 00000100:00100000:0.0:1789264261.587400:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789264261.587408:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876179322804864:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789264261.587437:0:6495:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6907 00000100:00080000:0.0:1789264261.587445:0:6495:0:(import.c:65:import_set_state_nolock()) ffff9c3aba910800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789264261.587466:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789264261.587585:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3621:x1876179322804864:12345-0@lo:39:umount.0 Request processed in 177us (376us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789264261.587593:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789264261.587615:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322804992 00000100:00100000:0.0:1789264261.587618:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322804992 00000100:00100000:0.0:1789264261.587641:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322805120 00000100:00100000:0.0:1789264261.587644:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322805120 00000100:00100000:0.0:1789264261.587670:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789264261.587677:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876179322804992:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789264261.587689:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6a49 00000100:00080000:0.0:1789264261.587695:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9c3abf5c3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789264261.587724:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789264261.587828:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3621:x1876179322804992:12345-0@lo:9:umount.0 Request processed in 151us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264261.587835:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789264261.587849:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789264261.587855:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876179322805120:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789264261.587866:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6b84 00000100:00080000:0.0:1789264261.587872:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9c39835f0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789264261.587894:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:0.0:1789264261.587962:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3621:x1876179322805120:12345-0@lo:9:umount.0 Request processed in 107us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264261.587969:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1789264261.587995:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789264261.588007:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789264261.588028:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa1fb000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789264261.588034:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322804864:0@lo:39:umount.0 00000100:00080000:0.0:1789264261.588044:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3abaa51000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789264261.588053:0:3621:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789264261.588055:0:3621:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789264261.588057:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322804992:0@lo:9:umount.0 00000100:00100000:0.0:1789264261.588066:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000100:00080000:0.0:1789264261.588069:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c39833d4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789264261.588076:0:3621:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789264261.588078:0:3621:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789264261.588080:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322805120:0@lo:9:umount.0 00010000:00010000:0.0:1789264261.588105:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264261.588513:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264261.589421:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789264261.600199:0:15214:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c3ab3028000) has no exports 00000020:00000080:1.0:1789264261.640006:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed676a 00000020:00000080:1.0:1789264261.640021:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3aae15e000/lustre-QMT0000_UUID 00000020:01000000:1.0:1789264261.640071:0:15214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789264261.640148:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aae15e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789264261.640172:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789264261.640181:0:15214:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789264261.640186:0:15214:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9c3ab27ccd28) has no exports 00000020:00000080:0.0:1789264261.640509:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6763 00000020:00000080:0.0:1789264261.640515:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3aae0e7800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789264261.640577:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aae0e7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789264261.640678:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789264261.640685:0:15214:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789264261.640689:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3aae0e2000/lustre-QMT0000_UUID 00000020:00000080:0.0:1789264261.640691:0:15214:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aae0e2000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789264261.640695:0:15214:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1789264261.769863:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264262.794454:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264263.178681:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322805248:0@lo:400:kworker.0 00000100:00100000:0.0:1789264263.178797:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264263.178851:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398463a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322805760:0@lo:400:kworker.0 00000100:00100000:0.0:1789264263.178880:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264263.178905:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322806272:0@lo:400:kworker.0 00000100:00100000:3.0:1789264263.178927:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398463b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322805504:0@lo:400:kworker.0 00000100:00100000:0.0:1789264263.178936:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264263.178967:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264263.178968:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789264263.178977:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322805376:0@lo:400:kworker.0 00000100:00100000:3.0:1789264263.178997:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1876179322806016:0@lo:400:kworker.0 00000100:00100000:0.0:1789264263.179010:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264263.179032:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264263.179035:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322805888:0@lo:400:kworker.0 00000100:00100000:3.0:1789264263.179062:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789264263.179066:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264263.179072:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322805632:0@lo:400:kworker.0 00000100:00100000:0.0:1789264263.179090:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322806400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789264263.179103:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264263.179124:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264263.179128:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322806144:0@lo:400:kworker.0 00000100:00100000:0.0:1789264263.179169:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322805760 00000100:00100000:0.0:1789264263.179177:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322805760 00000100:00100000:0.0:1789264263.179226:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322805504 00000100:00100000:0.0:1789264263.179229:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322805504 00000100:00100000:0.0:1789264263.179240:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322806016 00000100:00100000:0.0:1789264263.179243:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322806016 00000100:00100000:0.0:1789264263.179251:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322805632 00000100:00100000:0.0:1789264263.179254:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322805632 00000100:00100000:0.0:1789264263.179265:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789264263.179285:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322805760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264263.179328:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264263.179342:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322805760:12345-0@lo:400:kworker.0 Request processed in 57us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264263.179364:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322806144 00000100:00100000:0.0:1789264263.179369:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789264263.179370:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322806144 00000100:00100000:0.0:1789264263.179392:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789264263.179398:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3624:x1876179322805504:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789264263.179405:0:7904:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789264263.179411:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789264263.179421:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322806144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264263.179445:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3624:x1876179322805504:12345-0@lo:400:kworker.0 Request processed in 45us (477us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789264263.179452:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789264263.179468:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322806144:12345-0@lo:400:kworker.0 Request processed in 48us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264263.179473:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789264263.179485:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3624:x1876179322806016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264263.179486:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000020:00080000:0.0:1789264263.179495:0:7904:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789264263.179509:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789264263.179517:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3624:x1876179322805632:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789264263.179527:0:9197:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789264263.179528:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3624:x1876179322806016:12345-0@lo:400:kworker.0 Request processed in 41us (492us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789264263.179537:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789264263.179559:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322806272 00000100:00100000:0.0:1789264263.179563:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322806272 00000100:00100000:3.0:1789264263.179569:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3624:x1876179322805632:12345-0@lo:400:kworker.0 Request processed in 51us (465us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789264263.179576:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789264263.179595:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322805888 00000100:00100000:0.0:1789264263.179600:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322805888 00000100:00100000:0.0:1789264263.179626:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789264263.179634:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322806272:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789264263.179645:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789264263.179651:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789264263.179654:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789264263.179666:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322806400 00000100:00100000:3.0:1789264263.179671:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322806400 00000100:00100000:0.0:1789264263.179672:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322806272:12345-0@lo:400:kworker.0 Request processed in 39us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264263.179681:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789264263.179702:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789264263.179706:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789264263.179711:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322805888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264263.179718:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322806400:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789264263.179771:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322805888:12345-0@lo:400:kworker.0 Request processed in 62us (705us total) trans 0 rc 0/0 00002000:00000024:3.0:1789264263.179772:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789264263.179792:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789264263.179814:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322806400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264263.179822:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1789264263.179842:0:3624:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789264263.179848:0:3624:0:(import.c:65:import_set_state_nolock()) ffff9c3982013800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:3.0:1789264263.179849:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322805376 00000100:02000400:0.0:1789264263.179854:0:3624:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1789264263.179855:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322805376 00000100:00100000:3.0:1789264263.180799:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789264263.180806:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1876179322805376:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789264263.180813:0:6495:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789264263.180855:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1876179322805376:12345-0@lo:400:kworker.0 Request processed in 48us (1846us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789264263.180874:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1789264263.180929:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789264263.180934:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9c3ab7dec800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789264263.180938:0:3622:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789264263.180945:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9c3ab7dec800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789264263.180949:0:3622:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 172 00000100:00080000:3.0:1789264263.180967:0:3622:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c3ab7dec800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1789264263.180997:0:3622:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3984659880 x1876179322806528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789264263.181021:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322805376:0@lo:400:kworker.0 00000100:00100000:3.0:1789264263.181041:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322805888:0@lo:400:kworker.0 00000100:00100000:3.0:1789264263.181062:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322806400:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789264263.181074:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c398463a680 x1876179322805760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264263.181084:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398463a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322805760:0@lo:400:kworker.0 00000100:00100000:3.0:1789264263.181093:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322806272:0@lo:400:kworker.0 00000100:00100000:3.0:1789264263.181134:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322806528:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789264263.181187:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264263.181219:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322806528 00000100:00100000:3.0:1789264263.181225:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322806528 00000100:00100000:3.0:1789264263.181244:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789264263.181249:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1876179322806528:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1789264263.181261:0:6495:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789264263.181828:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322805248 00000100:00100000:2.0:1789264263.181841:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322805248 00000100:00100000:2.0:1789264263.181878:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789264263.181886:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3ab55e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:3622:x1876179322805248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264263.181941:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3ab55e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a+19:3622:x1876179322805248:12345-0@lo:400:kworker.0 Request processed in 56us (3152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264263.181948:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789264263.181995:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322805248:0@lo:400:kworker.0 00000100:00080000:0.0:1789264263.200033:0:3624:0:(import.c:65:import_set_state_nolock()) ffff9c3982013800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789264263.200044:0:3624:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 182 00000100:00080000:0.0:1789264263.200054:0:3624:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c3982013800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264263.200095:0:3624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c39847a6d80 x1876179322806656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789264263.200181:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1876179322806656:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789264263.200250:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264263.200311:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322806656 00000100:00100000:1.0:1789264263.200320:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322806656 00000100:00100000:0.0:1789264263.200343:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322805632:0@lo:400:kworker.0 00000100:00100000:1.0:1789264263.200368:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00010000:00080000:0.0:1789264263.200373:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3a8c73ea00 x1876179322806144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264263.200379:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3621:x1876179322806656:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789264263.200393:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322806144:0@lo:400:kworker.0 00010000:02000000:1.0:1789264263.200403:0:7904:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1789264263.200409:0:3624:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789264263.200414:0:3624:0:(import.c:65:import_set_state_nolock()) ffff9c3ab7f54800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789264263.200417:0:3624:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789264263.200421:0:3624:0:(import.c:65:import_set_state_nolock()) ffff9c3ab7f54800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789264263.200424:0:3624:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 172 00000100:00080000:0.0:1789264263.200429:0:3624:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c3ab7f54800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264263.200443:0:3624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c39847a6300 x1876179322806784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789264263.202243:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876179322806784:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789264263.202321:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264263.204660:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398463b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322805504:0@lo:400:kworker.0 00000100:00100000:1.0:1789264263.204667:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3621:x1876179322806656:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 4286us (4412us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789264263.204684:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789264263.204720:0:7904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322806784 00000100:00100000:1.0:1789264263.204728:0:7904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322806784 00000100:00080000:0.0:1789264263.205026:0:3624:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789264263.205032:0:3624:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa7e1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789264263.205036:0:3624:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789264263.205040:0:3624:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa7e1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789264263.205044:0:3624:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 196 00000100:00080000:0.0:1789264263.205050:0:3624:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c3aaa7e1800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264263.205081:0:3624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c39847a7480 x1876179322806912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789264263.205095:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1876179322806016:0@lo:400:kworker.0 00000100:00100000:1.0:1789264263.205379:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789264263.205387:0:7904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3621:x1876179322806784:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789264263.205403:0:7904:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789264263.205457:0:7904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3621:x1876179322806784:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 70us (3137us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789264263.205463:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1789264263.206026:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3982013800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789264263.206033:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789264263.206037:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1876179322806656:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789264263.206426:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1876179322806912:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789264263.206473:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789264263.206587:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3ab7f54800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789264263.206592:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789264263.206595:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876179322806784:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789264263.206672:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322806912 00000100:00100000:1.0:1789264263.206690:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322806912 00000100:00100000:1.0:1789264263.206732:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789264263.206737:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3621:x1876179322806912:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789264263.206770:0:6491:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789264263.206827:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3621:x1876179322806912:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 88us (353us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789264263.206834:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1789264263.207000:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa7e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789264263.207004:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789264263.207007:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1876179322806912:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789264263.219428:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1876179322806528:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 38167us (38230us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789264263.219442:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1789264263.220370:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3ab7dec800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789264263.220393:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789264263.220397:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322806528:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1789264263.818280:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789264264.718058:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789264264.718067:0:8398:0:(genops.c:885:class_export_put()) final put ffff9c3abf5c5800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789264264.718084:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 92638a4f-1391-4305-a4ab-5961bcacc46a 00000020:00000080:3.0:1789264264.718086:0:8398:0:(genops.c:885:class_export_put()) final put ffff9c3a88d17800/92638a4f-1391-4305-a4ab-5961bcacc46a 00000020:00000080:2.0:1789264264.718657:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3abf5c5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789264264.718706:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3a88d17800/92638a4f-1391-4305-a4ab-5961bcacc46a for lustre-OST0000 00000020:00000080:2.0:1789264264.718724:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3abf5c3000 for lustre-OST0000 00000020:00000080:2.0:1789264264.718729:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3a88d17000 for lustre-OST0000 00000001:00100000:0.0:1789264264.719699:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789264264.719707:0:6469:0:(genops.c:885:class_export_put()) final put ffff9c3ab7dea800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789264264.719733:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7381f06c-fe63-4f19-bfe0-7d6bc17e625e 00000001:00080000:0.0:1789264264.719764:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1789264264.719768:0:6469:0:(genops.c:885:class_export_put()) final put ffff9c3abf630000/7381f06c-fe63-4f19-bfe0-7d6bc17e625e 00000001:00100000:0.0:1789264264.719774:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 92638a4f-1391-4305-a4ab-5961bcacc46a 00000001:00080000:0.0:1789264264.719781:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1789264264.719789:0:6469:0:(genops.c:885:class_export_put()) final put ffff9c39833d5000/92638a4f-1391-4305-a4ab-5961bcacc46a 00000020:00000080:3.0:1789264264.719845:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ab7dea800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1789264264.719902:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3abf630000/7381f06c-fe63-4f19-bfe0-7d6bc17e625e for lustre-MDT0000 00000020:00000080:3.0:1789264264.719923:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c39833d5000/92638a4f-1391-4305-a4ab-5961bcacc46a for lustre-MDT0000 00000020:00000080:3.0:1789264264.719952:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3aae103000 for lustre-MDT0000 00000020:00000080:3.0:1789264264.719957:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3abf630800 for lustre-MDT0000 00000020:00000080:3.0:1789264264.719960:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c39833d7800 for lustre-MDT0000 00000001:00100000:1.0:1789264264.720036:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789264264.720040:0:9482:0:(genops.c:885:class_export_put()) final put ffff9c39835f3800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789264264.720060:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 92638a4f-1391-4305-a4ab-5961bcacc46a 00000020:00000080:1.0:1789264264.720062:0:9482:0:(genops.c:885:class_export_put()) final put ffff9c3983cea000/92638a4f-1391-4305-a4ab-5961bcacc46a 00000020:00000080:3.0:1789264264.720107:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c39835f3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789264264.720127:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3983cea000/92638a4f-1391-4305-a4ab-5961bcacc46a for lustre-OST0001 00000020:00000080:3.0:1789264264.720144:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c39835f0800 for lustre-OST0001 00000020:00000080:3.0:1789264264.720148:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3983ce9800 for lustre-OST0001 00000001:00100000:2.0:1789264264.720465:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789264264.720473:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1789264264.720476:0:7421:0:(genops.c:885:class_export_put()) final put ffff9c3aae102800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789264264.720493:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7381f06c-fe63-4f19-bfe0-7d6bc17e625e 00000001:00080000:2.0:1789264264.720498:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1789264264.720500:0:7421:0:(genops.c:885:class_export_put()) final put ffff9c3abf637800/7381f06c-fe63-4f19-bfe0-7d6bc17e625e 00000001:00100000:2.0:1789264264.720505:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 92638a4f-1391-4305-a4ab-5961bcacc46a 00000001:00080000:2.0:1789264264.720508:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1789264264.720510:0:7421:0:(genops.c:885:class_export_put()) final put ffff9c3abf682800/92638a4f-1391-4305-a4ab-5961bcacc46a 00000020:00000080:1.0:1789264264.720554:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aae102800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1789264264.720712:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3abf637800/7381f06c-fe63-4f19-bfe0-7d6bc17e625e for lustre-MDT0001 00000020:00000080:1.0:1789264264.720767:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3abf682800/92638a4f-1391-4305-a4ab-5961bcacc46a for lustre-MDT0001 00000020:00000080:1.0:1789264264.720789:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3aba910800 for lustre-MDT0001 00000020:00000080:1.0:1789264264.720793:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3abf637000 for lustre-MDT0001 00000020:00000080:1.0:1789264264.720796:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3abf686800 for lustre-MDT0001 00010000:00010000:0.0:1789264264.842635:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264265.738084:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322807040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789264265.738156:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264265.738325:0:11925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322807040 00000100:00100000:2.0:1789264265.738333:0:11925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322807040 00000100:00100000:2.0:1789264265.738456:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789264265.738467:0:11925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322807040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789264265.738507:0:11925:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789264265.738603:0:11925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322807040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264265.738610:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1789264265.741135:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264265.741269:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322807040:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789264265.869409:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789264265.930453:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789264266.890293:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789264267.725428:0:15214:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c39833463c0 - data ffff9c3aa9f47510/ffff9c3abab6f800 00000020:01000000:3.0:1789264267.725614:0:15214:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c3ab55eb1e0 - data ffff9c3aa9d5ebd0/ffff9c3ab27f1c00 00000001:00000004:3.0:1789264267.736927:0:15214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1789264267.796041:0:15214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789264267.796050:0:15214:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789264267.796080:0:15214:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c3983f51c00 x1876179322804864/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789264271 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264267.796105:0:15214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789264267.800683:0:15214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789264267.800691:0:15214:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1789264267.800710:0:15214:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789264267.800713:0:15214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789264267.801103:0:8856:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789264267.801108:0:8856:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1789264267.801118:0:8856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789264267.801589:0:15214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789264267.801593:0:15214:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:2.0:1789264267.801609:0:15214:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789264267.801611:0:15214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789264267.801927:0:10065:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789264267.801931:0:10065:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 2 00000040:00080000:1.0:1789264267.801940:0:10065:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789264267.805732:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6732 00000020:00000080:2.0:1789264267.805777:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3aaa7e4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789264267.806297:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aaa7e4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789264267.809003:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6747 00000020:00000080:2.0:1789264267.809017:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3a8c712800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789264267.809036:0:15214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789264267.809041:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789264267.809048:0:15214:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789264267.809052:0:15214:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9c3ab302cd28) has no exports 00000004:01000000:2.0:1789264267.809214:0:15214:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789264267.809223:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6b7d 00000020:00000080:2.0:1789264267.809227:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c39833d5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789264267.809231:0:15214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789264267.809234:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789264267.809252:0:15214:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789264267.809255:0:15214:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9c3aba8e99b8) has no exports 00000020:00000080:2.0:1789264267.809261:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6b76 00000020:00000080:2.0:1789264267.809265:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c39833d6000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1789264267.809579:0:15214:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789264267.809584:0:15214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789264267.809587:0:15214:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:2.0:1789264267.809592:0:15214:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789264267.809602:0:15214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789264267.809646:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789264267.809655:0:15214:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789264267.809665:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6a3b 00000020:00000080:2.0:1789264267.809670:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3982016000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789264267.809674:0:15214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789264267.809678:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789264267.809682:0:15214:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789264267.809684:0:15214:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9c3982364d28) has no exports 00000020:00000080:2.0:1789264267.809688:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6a34 00000020:00000080:2.0:1789264267.809691:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3ab7f52000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789264267.809853:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3a8c712800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789264267.809862:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c39833d5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789264267.809873:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c39833d6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789264267.809878:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c39833d4000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789264267.809883:0:36:0:(genops.c:885:class_export_put()) final put ffff9c3983125000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789264267.809885:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3983125000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789264267.809889:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789264267.809958:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3982016000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789264267.809962:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ab7f52000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789264267.812450:0:15214:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789264267.812459:0:15214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789264267.812463:0:15214:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1789264267.812472:0:15214:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789264267.812474:0:15214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789264267.812524:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789264267.812538:0:15214:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1789264267.812556:0:15214:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789264267.812564:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6900 00000020:00000080:2.0:1789264267.812573:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3abaa54000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789264267.812578:0:15214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1789264267.812596:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789264267.812602:0:15214:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789264267.812606:0:15214:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c3aba8ecd28) has no exports 00000020:00000080:2.0:1789264267.812613:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed68f9 00000020:00000080:2.0:1789264267.812617:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3aaa1fd800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789264267.812740:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3abaa51000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789264267.812773:0:36:0:(genops.c:885:class_export_put()) final put ffff9c3982014000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789264267.812776:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3982014000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789264267.812782:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789264267.812863:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3abaa54000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789264267.812868:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aaa1fd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789264267.849211:0:15214:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789264267.849220:0:15214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789264267.849224:0:15214:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789264267.849231:0:15214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789264267.849290:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789264267.849305:0:15214:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789264267.849330:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789264267.849333:0:15214:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789264267.849339:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3aaa7e6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789264267.849343:0:15214:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aaa7e6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789264267.849355:0:15214:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789264267.849448:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed674e 00000020:00000080:0.0:1789264267.849455:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3a8c714000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789264267.849460:0:15214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789264267.849463:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789264267.849476:0:15214:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789264267.849480:0:15214:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9c3ab302b370) has no exports 00000020:00000080:0.0:1789264267.849499:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789264267.849502:0:15214:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789264267.849506:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6755 00000020:00000080:0.0:1789264267.849510:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3a8c717800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789264267.849518:0:15214:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c3a89eb9800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789264267.849521:0:15214:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3a89eb9800 3 00000020:01000004:0.0:1789264267.849523:0:15214:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c3a89eb9800 from lustre-MDT0000 00000020:00000080:0.0:1789264267.849546:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789264267.849549:0:15214:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789264267.849552:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3aaa7e2000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789264267.849554:0:15214:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aaa7e2000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789264267.849561:0:15214:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789264267.849592:0:15214:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789264267.849595:0:15214:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789264267.849598:0:15214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789264267.849601:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789264267.849603:0:15214:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789264267.849609:0:15214:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9c3ab5601800 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789264267.849614:0:15214:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9c3ab27c99b8) has exports, disconnecting them 00000020:00080000:0.0:1789264267.849618:0:15214:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c3ab5601800), last request at 1789264080 00000020:00000080:0.0:1789264267.849637:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed66f3 00000020:00010000:0.0:1789264267.849641:0:15214:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c3ab5601800: total 2 00000100:00080000:0.0:1789264267.849645:0:15214:0:(import.c:65:import_set_state_nolock()) ffff9c3a85666800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789264267.849659:0:15214:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c3ab5601800): rc 0 00000020:00080000:0.0:1789264267.849663:0:15214:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9c3ab27c99b8) has no exports 00000020:00010000:0.0:1789264267.849674:0:7431:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c3ab5601800: total 2 00010000:00010000:0.0:1789264267.849699:0:7431:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c3ab5601800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789264267.849729:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f095000/0xecaf9f2f14ed6c10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c09 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264267.849783:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3ab5623600/0xecaf9f2f14ed6e8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6e86 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264267.849794:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a80030400/0xecaf9f2f14ed6c72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c6b expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264267.849804:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f095400/0xecaf9f2f14ed6c02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6bfb expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264267.849814:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f095800/0xecaf9f2f14ed6b14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6b0d expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264267.849827:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c398366a600/0xecaf9f2f14ed6ea9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6ea2 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789264267.849931:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3aaa1fb000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789264267.849939:0:36:0:(genops.c:885:class_export_put()) final put ffff9c3aba90a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789264267.849941:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aba90a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789264267.849948:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789264267.849999:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3a8c714000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789264267.850009:0:36:0:(genops.c:885:class_export_put()) final put ffff9c3aaa7e7000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789264267.850011:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aaa7e7000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789264267.850014:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789264267.850042:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3a8c717800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789264267.850101:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f094800/0xecaf9f2f14ed6c1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c17 expref: 8 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264267.850113:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c398366b600/0xecaf9f2f14ed6e9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6e94 expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264267.850125:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a80030000/0xecaf9f2f14ed6c2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c25 expref: 6 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264267.850135:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f095c00/0xecaf9f2f14ed6c3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c33 expref: 5 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264267.850147:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a813fd200/0xecaf9f2f14ed67ef lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed67e8 expref: 4 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264267.850173:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8f094e00/0xecaf9f2f14ed6c48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed6c41 expref: 3 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264267.850185:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a813fc400/0xecaf9f2f14ed67fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xecaf9f2f14ed67f6 expref: 2 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264267.850195:0:7431:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c3ab5601800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1789264267.850210:0:7431:0:(genops.c:885:class_export_put()) final put ffff9c3ab5601800/91066a17-aaf7-4689-9b8a-2d7c8cfdba8a 00010000:00010000:0.0:1789264267.850225:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264267.850227:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264267.850229:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264267.850304:0:6484:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c3aaa4ba600:6484] 1 exiting: rc = 0 00000100:00100000:1.0:1789264267.850442:0:6482:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c3a8f39a400:6482] 0 exiting: rc = 1 00000020:00000080:1.0:1789264267.850478:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ab5601800/91066a17-aaf7-4689-9b8a-2d7c8cfdba8a for MGS 00000020:00000080:1.0:1789264267.850509:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3a85666800 for MGS 00000100:00100000:2.0:1789264267.852388:0:6485:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c3aaa4bba00:6485] 2 exiting: rc = 0 00000100:00100000:0.0:1789264267.852948:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.852957:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.852963:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.852972:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.852981:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.852987:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.852993:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.852998:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853004:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853010:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853017:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853022:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853028:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853034:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853040:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853046:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853052:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853058:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853063:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853081:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853086:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853091:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853097:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853102:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853108:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853113:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853118:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853123:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853127:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853132:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853136:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853141:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853147:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853151:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853157:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853162:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853166:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853170:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853175:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853180:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853185:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853190:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853195:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853200:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853205:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853210:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853214:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853219:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853223:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853228:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853233:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853251:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853257:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853262:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853273:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853278:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853284:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853290:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853294:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853300:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853307:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853312:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853317:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264267.853323:0:15214:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1789264267.854273:0:15214:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c3abab2f060 - data ffff9c3aa9f3d798/ffff9c3abafe4400 00000020:01000000:0.0:1789264267.854394:0:15214:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c3aaa085600 - data ffff9c3aa9c80948/ffff9c3aaa0b2000 00000020:00000080:0.0:1789264267.855014:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed66d7 00000020:00000080:0.0:1789264267.855024:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3ab5607800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789264267.855039:0:15214:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c3a89eb9800 from MGS, refs=2 00000020:01000004:0.0:1789264267.855042:0:15214:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3a89eb9800 2 00000020:01000004:0.0:1789264267.855045:0:15214:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c3a89eb9800 from MGS 00000020:00000080:0.0:1789264267.855066:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789264267.855072:0:15214:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789264267.855074:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3ab5607000/MGS 00000020:00000080:0.0:1789264267.855077:0:15214:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ab5607000/MGS for MGS 00000020:01000000:0.0:1789264267.855083:0:15214:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789264267.855144:0:15214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789264267.855148:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789264267.855153:0:15214:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789264267.855158:0:15214:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c3a82d4d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789264267.855162:0:15214:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9c3ab30299b8) has exports, disconnecting them 00000020:00080000:0.0:1789264267.855167:0:15214:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c3a82d4d000), last request at 1789264080 00000020:00000080:0.0:1789264267.855171:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed67a2 00000020:00080000:0.0:1789264267.855180:0:15214:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c3a82d4d000): rc 0 00000020:00000080:0.0:1789264267.855183:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3a82d4d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789264267.855347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ab5607800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789264267.855354:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3a82d4d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789264267.859799:0:15214:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789264267.859821:0:15214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789264267.859825:0:15214:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789264267.859904:0:15214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789264267.860090:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789264267.860099:0:15214:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789264267.860106:0:15214:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3a89eb9800 1 00000020:00000080:0.0:1789264267.860112:0:15214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed66c9 00000020:00000080:0.0:1789264267.860120:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3ab5600000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789264267.860125:0:15214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789264267.860129:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789264267.860134:0:15214:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789264267.860137:0:15214:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9c3aaa4919b8) has no exports 00000020:00000080:2.0:1789264267.861937:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3aaa7e6800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789264267.861951:0:37:0:(genops.c:885:class_export_put()) final put ffff9c3aaa7e5000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789264267.861954:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aaa7e5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789264267.861962:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789264267.862056:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ab5600000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789264267.903216:0:15214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789264267.903229:0:15214:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789264267.903234:0:15214:0:(genops.c:885:class_export_put()) final put ffff9c3a85663800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789264267.903248:0:15214:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3a85663800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789264267.903300:0:15214:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789264267.903413:0:15214:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c3a89ebd800 00000020:02000400:0.0:1789264267.903535:0:15214:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789264267.926776:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789264268.297881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789264268.297887:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789264268.297890:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c3ab7dec800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789264268.297898:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 343 00000100:00080000:2.0:1789264268.297904:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789264268.297910:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c3ab7dec800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1789264268.297932:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3a8c73ca80 x1876179322807296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789264268.297949:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789264268.297952:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789264268.297954:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c3ab7f54800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789264268.297958:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 343 00000100:00080000:2.0:1789264268.297960:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789264268.297963:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c3ab7f54800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1789264268.297975:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3a8c73f100 x1876179322807424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789264268.297984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789264268.297987:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789264268.297988:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c3982013800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789264268.297991:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 343 00000100:00080000:2.0:1789264268.297993:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789264268.297996:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c3982013800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1789264268.298006:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3a8c73ed80 x1876179322807552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789264268.298052:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789264268.298056:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789264268.298057:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa7e1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789264268.298061:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 343 00000100:00080000:2.0:1789264268.298064:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789264268.298067:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c3aaa7e1800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1789264268.298077:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3a8c73c700 x1876179322807936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789264268.298118:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322808064:0@lo:400:kworker.0 00000100:00100000:2.0:1789264268.298180:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264268.298255:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789264268.298262:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322807168:0@lo:400:kworker.0 00000400:00000100:2.0:1789264268.298282:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876179322807168 offset 0 length 224: 4 00000100:00100000:2.0:1789264268.298398:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322808192:0@lo:400:kworker.0 00000100:00100000:2.0:1789264268.298425:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264268.298455:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322807296:0@lo:38:kworker.0 00000100:00100000:2.0:1789264268.298479:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264268.298498:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876179322807424:0@lo:38:kworker.0 00000100:00100000:2.0:1789264268.298517:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264268.298533:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1876179322807552:0@lo:38:kworker.0 00000100:00100000:2.0:1789264268.298548:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264268.298558:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1876179322807936:0@lo:38:kworker.0 00000100:00100000:2.0:1789264268.298568:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264268.298593:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322807680:0@lo:400:kworker.0 00000100:00100000:2.0:1789264268.298617:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264268.298635:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789264268.298641:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322807808:0@lo:400:kworker.0 00000100:00100000:2.0:1789264268.298665:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264268.298704:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322808064 00000100:00100000:2.0:1789264268.298711:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322808064 00000100:00100000:3.0:1789264268.298721:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789264268.298734:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322808320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264268.298778:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322807424 00000100:00100000:2.0:1789264268.298782:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322807424 00000100:00100000:3.0:1789264268.298794:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264268.298795:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322807552 00000100:00100000:2.0:1789264268.298799:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322807552 00000100:00100000:2.0:1789264268.298810:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322807936 00000100:00100000:2.0:1789264268.298813:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322807936 00000100:00100000:2.0:1789264268.298823:0:9197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322807680 00000100:00100000:2.0:1789264268.298825:0:9197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322807680 00000100:00080000:3.0:1789264268.298834:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789264268.298851:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322808320 00000100:00100000:2.0:1789264268.298851:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789264268.298857:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322808320 00000100:00100000:2.0:1789264268.298864:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322808064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264268.298898:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789264268.298907:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322808320:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264268.298919:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876179322808064:12345-0@lo:400:kworker.0 Request processed in 57us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264268.298929:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00002000:00000024:3.0:1789264268.298931:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789264268.298949:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789264268.298957:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322807680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264268.298978:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322808320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264268.298991:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876179322807680:12345-0@lo:400:kworker.0 Request processed in 33us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264268.298999:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789264268.299000:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789264268.299023:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789264268.299027:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3621:x1876179322807424:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789264268.299045:0:9197:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789264268.299089:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3621:x1876179322807424:12345-0@lo:38:kworker.0 Request processed in 60us (570us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789264268.299095:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789264268.299107:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789264268.299111:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3621:x1876179322807552:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789264268.299120:0:9197:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789264268.299142:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3621:x1876179322807552:12345-0@lo:38:kworker.0 Request processed in 29us (591us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789264268.299147:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789264268.299158:0:9197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00080000:3.0:1789264268.299159:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789264268.299164:0:9197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3621:x1876179322807936:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789264268.299172:0:9197:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1789264268.299192:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c3a8c73fb80 x1876179322807680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264268.299194:0:9197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3621:x1876179322807936:12345-0@lo:38:kworker.0 Request processed in 30us (623us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789264268.299208:0:9197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789264268.299217:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1876179322807680:0@lo:400:kworker.0 00000100:00100000:3.0:1789264268.299268:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322808320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264268.299353:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322808192 00000100:00100000:2.0:1789264268.299357:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322808192 00000100:00100000:2.0:1789264268.299413:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322807808 00000100:00100000:2.0:1789264268.299417:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322807808 00000100:00100000:0.0:1789264268.301146:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789264268.301163:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322808192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264268.301256:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322808192:12345-0@lo:400:kworker.0 Request processed in 99us (2829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264268.301264:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789264268.301286:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789264268.301293:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322807808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264268.301336:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322807808:12345-0@lo:400:kworker.0 Request processed in 43us (2671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264268.301357:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789264268.303208:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322807296 00000100:00100000:3.0:1789264268.303218:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322807296 00000100:00100000:3.0:1789264268.303305:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789264268.303313:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3621:x1876179322807296:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789264268.303333:0:6496:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789264268.303392:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3621:x1876179322807296:12345-0@lo:38:kworker.0 Request processed in 78us (4911us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789264268.303398:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1789264268.303455:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3ab7dec800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789264268.303460:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789264268.303463:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322807296:0@lo:38:kworker.0 00000100:00080000:3.0:1789264268.303474:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3ab7f54800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789264268.303477:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789264268.303480:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876179322807424:0@lo:38:kworker.0 00000100:00080000:3.0:1789264268.303489:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3982013800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789264268.303493:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789264268.303496:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1876179322807552:0@lo:38:kworker.0 00000100:00080000:3.0:1789264268.303518:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa7e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789264268.303521:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789264268.303524:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1876179322807936:0@lo:38:kworker.0 00000100:00100000:3.0:1789264268.303562:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322808192:0@lo:400:kworker.0 00010000:00080000:3.0:1789264268.303575:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c3a8c73ce00 x1876179322808064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264268.303583:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322808064:0@lo:400:kworker.0 00000100:00080000:3.0:1789264268.303604:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789264268.306564:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322807808:0@lo:400:kworker.0 00010000:00010000:2.0:1789264268.939456:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264269.962862:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789264270.777486:0:15417:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789264270.789292:0:15417:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789264270.789346:0:15417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.789362:0:15417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.789370:0:15417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.789378:0:15417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.789433:0:15417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789264270.789439:0:15417:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789264270.789470:0:15417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789264270.789475:0:15417:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789264270.789480:0:15417:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789264270.789486:0:15417:0:(import.c:65:import_set_state_nolock()) ffff9c3ab7f54800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789264270.789503:0:15417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789264270.789505:0:15417:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789264270.789508:0:15417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789264270.790333:0:15417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790344:0:15417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790351:0:15417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790356:0:15417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264270.790407:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789264270.790414:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264270.790422:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8f095600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264270.790426:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264270.790434:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264270.790442:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264270.790448:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789264270.790452:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789264270.790454:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789264270.790488:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264270.790495:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264270.790523:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264270.790530:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8f095600/0xecaf9f2f14ed6c33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264270.790531:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1789264270.790543:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789264270.790550:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322808448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264270.790554:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264270.790559:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a80030200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264270.790562:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264270.790568:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264270.790573:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264270.790577:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789264270.790579:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1789264270.790591:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264270.790596:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264270.790608:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264270.790613:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789264270.790615:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264270.790617:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264270.790619:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264270.790627:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789264270.790635:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322808576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264270.790658:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264270.790683:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322808448 00000100:00100000:0.0:1789264270.790683:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322808576 00000100:00100000:1.0:1789264270.790688:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322808448 00000100:00100000:0.0:1789264270.790688:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322808576 00010000:00010000:3.0:1789264270.790721:0:15417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789264270.790726:0:15417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a80030200/0xecaf9f2f14ed6c41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790738:0:15417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790760:0:15417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790765:0:15417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790771:0:15417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790793:0:15417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789264270.790799:0:15417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790805:0:15417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790811:0:15417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790817:0:15417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790827:0:15417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789264270.790832:0:15417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a813fcc00/0xecaf9f2f14ed67f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790837:0:15417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a813fcc00/0xecaf9f2f14ed67f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790843:0:15417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a813fcc00/0xecaf9f2f14ed67f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790849:0:15417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3a813fcc00/0xecaf9f2f14ed67f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264270.790856:0:15417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1789264270.790858:0:15417:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1789264270.790867:0:15417:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789264270.790894:0:15417:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789264270.790898:0:15417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789264270.790901:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789264270.790907:0:15417:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789264270.790912:0:15417:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9c3982345800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789264270.790917:0:15417:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9c39820da000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789264270.790922:0:15417:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9c3ab27cb370) has exports, disconnecting them 00000020:00080000:3.0:1789264270.790926:0:15417:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c3982345800), last request at 1789264268 00000020:00000080:3.0:1789264270.790933:0:15417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6ad5 00000100:00080000:3.0:1789264270.790948:0:15417:0:(import.c:65:import_set_state_nolock()) ffff9c39835f4000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789264270.790985:0:15417:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c3982345800): rc 0 00000020:00000080:3.0:1789264270.790988:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3982345800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789264270.790997:0:15417:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c39820da000), last request at 1789264268 00000020:00000080:3.0:1789264270.791000:0:15417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed69af 00000100:00080000:3.0:1789264270.791006:0:15417:0:(import.c:65:import_set_state_nolock()) ffff9c39820d9800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789264270.791012:0:15417:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c39820da000): rc 0 00000020:00000080:3.0:1789264270.791014:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c39820da000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789264270.791020:0:15417:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb65101cb3ae0 00000100:00080000:3.0:1789264270.791035:0:15417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789264270.791038:0:15417:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1789264270.791226:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789264270.791232:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791239:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a80030c00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264270.791242:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791260:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264270.791267:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264270.791273:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789264270.791275:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789264270.791276:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789264270.791292:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791298:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789264270.791310:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791316:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a80030c00/0xecaf9f2f14ed6b0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6b14 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791328:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789264270.791332:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791337:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264270.791340:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791346:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264270.791362:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264270.791368:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789264270.791370:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789264270.791372:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789264270.791383:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791388:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789264270.791398:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791405:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c398366b200/0xecaf9f2f14ed6ea2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed6ea9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791414:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264270.791417:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a813fcc00/0xecaf9f2f14ed67f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791423:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fcc00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264270.791425:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a813fcc00/0xecaf9f2f14ed67f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791432:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a813fcc00/0xecaf9f2f14ed67f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264270.791437:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a813fcc00/0xecaf9f2f14ed67f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264270.791452:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789264270.791455:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789264270.791456:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789264270.791468:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a813fcc00/0xecaf9f2f14ed67f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791474:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789264270.791480:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a813fcc00/0xecaf9f2f14ed67f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791486:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a813fcc00/0xecaf9f2f14ed67f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xecaf9f2f14ed67fd expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264270.791497:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264270.791499:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264270.791500:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264270.791511:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322808704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789264270.791555:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264270.791586:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322808960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789264270.791606:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264270.791621:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789264270.791626:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322808832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789264270.791643:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264270.791674:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322808704 00000100:00100000:2.0:1789264270.791678:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322808704 00000100:00100000:1.0:1789264270.791728:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322808960 00000100:00100000:1.0:1789264270.791731:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322808960 00000100:00100000:0.0:1789264270.791790:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322808832 00000100:00100000:0.0:1789264270.791800:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322808832 00000100:00100000:0.0:1789264270.791816:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789264270.791823:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3622:x1876179322808448:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789264270.791829:0:6476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789264270 with bad export cookie 17055025338438739699 00000100:00100000:2.0:1789264270.792196:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789264270.792202:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3625:x1876179322808576:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789264270.792206:0:6477:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789264270 with bad export cookie 17055025338438739699 00000100:00100000:2.0:1789264270.792266:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3625:x1876179322808576:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (1605us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789264270.792274:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789264270.792292:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789264270.792297:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983621180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3623:x1876179322808832:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789264270.792301:0:6477:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789264270 with bad export cookie 17055025338438739699 00000100:00100000:2.0:1789264270.792330:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983621180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3623:x1876179322808832:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (685us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789264270.792336:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789264270.792349:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789264270.792353:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983620000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3625:x1876179322808704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789264270.792357:0:6477:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789264270 with bad export cookie 17055025338438739699 00000100:00100000:2.0:1789264270.792380:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983620000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3625:x1876179322808704:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (825us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789264270.792386:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789264270.792420:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789264270.792423:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9c3a8f246000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789264270.792427:0:3623:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.144@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1789264270.792622:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789264270.792628:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983621f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3623:x1876179322808960:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789264270.792632:0:8420:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789264270 with bad export cookie 17055025338438739699 00000100:00100000:1.0:1789264270.792721:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983621f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3623:x1876179322808960:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (1113us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789264270.792728:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789264270.793196:0:15417:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789264270.793201:0:15417:0:(import.c:65:import_set_state_nolock()) ffff9c3ab7dec800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789264270.794365:0:3625:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:00000080:1.0:1789264270.794786:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3982345800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1789264270.794831:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c39820da000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1789264270.794848:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c39835f4000 for lustre-MDT0001 00000020:00000080:1.0:1789264270.794861:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c39820d9800 for lustre-MDT0001 00010000:00010000:1.0:1789264270.794870:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264270.794875:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264270.799321:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3622:x1876179322808448:12345-0@lo:103:ldlm_bl.0 Request processed in 7492us (8703us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789264270.799332:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789264270.799347:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789264270.813516:0:3623:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.144@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789264270.813522:0:3623:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789264270.813531:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c3a8c73d880 x1876179322807168/t0(0) o400->MGC192.168.203.144@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789264284 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264270.813599:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c39847a5880 x1876179322808448/t0(0) o103->MGC192.168.203.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789264286 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264270.813610:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c39847a7480 x1876179322808576/t0(0) o103->MGC192.168.203.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789264286 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264270.813643:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c3983622d80 x1876179322808704/t0(0) o103->MGC192.168.203.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789264286 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264270.813651:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c3983621500 x1876179322808960/t0(0) o103->MGC192.168.203.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789264286 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264270.813660:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c3983623800 x1876179322808832/t0(0) o103->MGC192.168.203.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789264286 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264270.813696:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3624:1876179322807168:0@lo:400:kworker.0 10000000:01000000:2.0:1789264270.813717:0:3623:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789264270.813720:0:3623:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789264270.813721:0:3623:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789264270.813810:0:3625:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c3a8f246000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:3.0:1789264270.813880:0:15417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789264270.813885:0:15417:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1789264270.813899:0:15417:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789264270.813966:0:15417:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789264270.814000:0:3622:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c3a8f246000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789264270.814032:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3622:1876179322808448:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789264270.814098:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9c3a8f246000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789264270.814104:0:3623:0:(import.c:510:import_select_connection()) MGC192.168.203.144@tcp: connect to NID 0@lo last attempt 160 00000100:00080000:2.0:1789264270.814112:0:3623:0:(import.c:624:import_select_connection()) MGC192.168.203.144@tcp: import ffff9c3a8f246000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264270.814159:0:3623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c39847a6d80 x1876179322809088/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789264270.814207:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3621:1876179322809088:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1789264270.814261:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876179322809088 offset 0 length 520: 4 00000100:00100000:0.0:1789264270.814316:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322808960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264270.814330:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3623:1876179322808832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264270.814560:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:0:1876179322809216:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789264270.815108:0:15417:0:(import.c:65:import_set_state_nolock()) ffff9c3ababd8000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789264270.815129:0:15417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789264270.815132:0:15417:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1789264270.815147:0:15417:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789264270.815200:0:15417:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789264270.815212:0:15417:0:(import.c:65:import_set_state_nolock()) ffff9c39833d7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789264270.815249:0:15417:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c3ab27cb370) has no exports 00000100:00100000:1.0:1789264270.815284:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322809344:0@lo:9:umount.0 00000100:00100000:1.0:1789264270.815328:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264270.815362:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322809472:0@lo:9:umount.0 00000100:00100000:1.0:1789264270.815384:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264270.815419:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322809344 00000100:00100000:1.0:1789264270.815426:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322809344 00000100:00100000:1.0:1789264270.815472:0:11052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322809472 00000100:00100000:1.0:1789264270.815475:0:11052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322809472 00000100:00100000:2.0:1789264270.815483:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789264270.815493:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876179322809344:12345-0@lo:9:umount.0 00000100:00100000:1.0:1789264270.815497:0:11052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789264270.815501:0:11052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3621:x1876179322809472:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789264270.815516:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed69fc 00000020:00000080:1.0:1789264270.815516:0:11052:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6b4c 00000100:00080000:2.0:1789264270.815522:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9c3982346000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789264270.815523:0:11052:0:(import.c:65:import_set_state_nolock()) ffff9c3abaff2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789264270.815602:0:11052:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1789264270.815735:0:11052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3621:x1876179322809472:12345-0@lo:9:umount.0 Request processed in 232us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264270.815760:0:11052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1789264270.815780:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789264270.815784:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789264270.815807:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322808576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789264270.815825:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3625:1876179322808704:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789264270.816165:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:3.0:1789264270.816184:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264270.816272:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3621:x1876179322809344:12345-0@lo:9:umount.0 Request processed in 780us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264270.816279:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1789264270.818820:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3ababd8000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789264270.818841:0:3621:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789264270.818844:0:3621:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789264270.818849:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322809344:0@lo:9:umount.0 00000100:00080000:0.0:1789264270.818864:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c39833d7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789264270.818875:0:3621:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789264270.818877:0:3621:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789264270.818879:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322809472:0@lo:9:umount.0 00010000:00010000:1.0:1789264270.819920:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789264270.827982:0:15417:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c3ab27cb370) has no exports 00000020:01000000:2.0:1789264270.860162:0:15417:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c3abab2fea0 - data ffff9c3aa9f49000/ffff9c3abafe5800 00000020:01000000:2.0:1789264270.860347:0:15417:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c3aba832420 - data ffff9c3aa9d78510/ffff9c3ab7df5000 00000001:00000004:2.0:1789264270.873722:0:15417:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1789264270.901851:0:15417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789264270.901861:0:15417:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789264270.901868:0:15417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789264270.903333:0:15417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789264270.903347:0:15417:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1789264270.903356:0:15417:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789264270.903358:0:15417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789264270.904015:0:8850:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789264270.904021:0:8850:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789264270.904032:0:8850:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789264270.904767:0:15417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789264270.904772:0:15417:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1789264270.904789:0:15417:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789264270.904791:0:15417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789264270.905078:0:10061:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789264270.905082:0:10061:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1789264270.905090:0:10061:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789264270.906093:0:15417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6819 00000020:00000080:0.0:1789264270.906103:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3a8c710000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789264270.906235:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3a8c710000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789264270.907691:0:15417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed682e 00000020:00000080:0.0:1789264270.907700:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3aaa7e0000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789264270.907790:0:15417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1789264270.907795:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789264270.907802:0:15417:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789264270.907806:0:15417:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9c3ab27c8000) has no exports 00000004:01000000:0.0:1789264270.907948:0:15417:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789264270.907960:0:15417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6b37 00000020:00000080:0.0:1789264270.907965:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3983121000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789264270.908065:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aaa7e0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789264270.908122:0:15417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789264270.908126:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789264270.908133:0:15417:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789264270.908136:0:15417:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9c3ab6923370) has no exports 00000020:00000080:0.0:1789264270.908141:0:15417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6b30 00000020:00000080:0.0:1789264270.908144:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c39833d0800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789264270.908171:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3983121000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789264270.908469:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c39833d0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789264270.908899:0:15417:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789264270.908904:0:15417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789264270.908908:0:15417:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1789264270.908913:0:15417:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789264270.908915:0:15417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789264270.908946:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789264270.908954:0:15417:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789264270.908959:0:15417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed69f5 00000020:00000080:0.0:1789264270.908970:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3982011000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789264270.908974:0:15417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789264270.908977:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789264270.908981:0:15417:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789264270.908983:0:15417:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9c3ab6813370) has no exports 00000020:00000080:0.0:1789264270.908987:0:15417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed69ee 00000020:00000080:0.0:1789264270.908990:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3ababdf000/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1789264270.909562:0:15417:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789264270.909566:0:15417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789264270.909569:0:15417:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:0.0:1789264270.909573:0:15417:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789264270.909575:0:15417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789264270.909610:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789264270.909673:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c39833d7000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789264270.909682:0:36:0:(genops.c:885:class_export_put()) final put ffff9c39833d1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789264270.909684:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c39833d1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1789264270.909689:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789264270.909774:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3982011000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1789264270.909779:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ababdf000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789264270.909783:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3ababd8000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789264270.909889:0:15417:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789264270.909893:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c39820df800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789264270.909896:0:15417:0:(genops.c:844:class_export_destroy()) destroying export ffff9c39820df800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789264270.909900:0:15417:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1789264270.909957:0:15417:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789264270.909963:0:15417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6851 00000020:00000080:0.0:1789264270.909968:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3a8e276000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789264270.909982:0:15417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1789264270.909986:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789264270.909990:0:15417:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789264270.909993:0:15417:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9c3aaa493370) has no exports 00000020:00000080:0.0:1789264270.909998:0:15417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed684a 00000020:00000080:0.0:1789264270.910000:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3ab7dea000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789264270.910350:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3a8e276000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789264270.910356:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ab7dea000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789264270.912832:0:15417:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1789264270.912839:0:15417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789264270.912843:0:15417:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1789264270.912850:0:15417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789264270.912901:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789264270.912912:0:15417:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789264270.912946:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789264270.912950:0:15417:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789264270.912956:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3aaa1f8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789264270.912960:0:15417:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aaa1f8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1789264270.912967:0:15417:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789264270.913161:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3ab7dec800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789264270.913181:0:15417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6835 00000020:00000080:1.0:1789264270.913188:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3aaa7e7800/lustre-MDD0001_UUID 00000020:01000000:1.0:1789264270.913199:0:15417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1789264270.913213:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789264270.913227:0:15417:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789264270.913231:0:15417:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9c3ab69219b8) has no exports 00000020:00000080:1.0:1789264270.913250:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789264270.913252:0:15417:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1789264270.913256:0:15417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed683c 00000020:00000080:1.0:1789264270.913259:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3aaa7e3800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1789264270.913273:0:15417:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c3aae2b1800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1789264270.913276:0:15417:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3aae2b1800 2 00000020:01000004:1.0:1789264270.913278:0:15417:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c3aae2b1800 from lustre-MDT0001 00000020:00000080:1.0:1789264270.913296:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789264270.913308:0:15417:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1789264270.913311:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3a8c716800/lustre-MDT0001_UUID 00000020:00000080:1.0:1789264270.913313:0:15417:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3a8c716800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1789264270.913319:0:15417:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1789264270.913346:0:15417:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1789264270.913349:0:15417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1789264270.913351:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789264270.913354:0:15417:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789264270.913359:0:15417:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9c3ab7f53800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789264270.913364:0:15417:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9c3ab6924d28) has exports, disconnecting them 00000020:00080000:1.0:1789264270.913367:0:15417:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9c3ab7f53800), last request at 1789264091 00000020:00000080:1.0:1789264270.913370:0:15417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6890 00000020:00080000:1.0:1789264270.913380:0:15417:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c3ab7f53800): rc 0 00000020:00000080:1.0:1789264270.913383:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3ab7f53800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789264270.913423:0:36:0:(genops.c:885:class_export_put()) final put ffff9c3aaa1f8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789264270.913425:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aaa1f8000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1789264270.913429:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789264270.913540:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aaa7e7800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1789264270.913544:0:36:0:(genops.c:885:class_export_put()) final put ffff9c3aaa7e3000/lustre-MDD0001_UUID 00000020:00000080:2.0:1789264270.913546:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aaa7e3000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1789264270.913548:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1789264270.913864:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aaa7e3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789264270.913873:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ab7f53800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1789264270.923807:0:15417:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1789264270.923817:0:15417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789264270.923821:0:15417:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789264270.923829:0:15417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789264270.923863:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3ab7f54800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789264270.924074:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789264270.924084:0:15417:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1789264270.924104:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3ab7f51000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1789264270.924108:0:15417:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ab7f51000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1789264270.924114:0:15417:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1789264270.924186:0:15417:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3aae2b1800 1 00000020:00000080:2.0:1789264270.924192:0:15417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed67cc 00000020:00000080:2.0:1789264270.924199:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3aa9881800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1789264270.924208:0:15417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1789264270.924225:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aa9881800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789264270.924240:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789264270.924245:0:15417:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789264270.924248:0:15417:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9c3ab68119b8) has no exports 00000020:00000080:2.0:1789264270.975775:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789264270.975788:0:15417:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789264270.975794:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3aae2b5000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789264270.975798:0:15417:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aae2b5000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789264270.975809:0:15417:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789264270.975921:0:15417:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c3aae2b2000 00000020:01000000:2.0:1789264270.975940:0:15417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789264270.975945:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789264270.975949:0:15417:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789264270.975953:0:15417:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9c3aaa490000) has no exports 00000100:00100000:3.0:1789264270.976093:0:9197:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9c3abab02a00:9197] 4 exiting: rc = 0 00000100:00100000:0.0:1789264270.976134:0:7904:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9c3aba8dc600:7904] 3 exiting: rc = 0 00000100:00100000:3.0:1789264270.976258:0:6491:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9c3ab2791400:6491] 1 exiting: rc = 0 00000100:00100000:1.0:1789264270.976362:0:6492:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9c3aaa6d8400:6492] 2 exiting: rc = 0 00000100:00100000:1.0:1789264270.976456:0:6490:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9c3ab2791200:6490] 0 exiting: rc = 1 00000100:00100000:2.0:1789264270.976538:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976546:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976553:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976558:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976564:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976570:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976575:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976580:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976585:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976590:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976595:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976609:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976614:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976618:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976623:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976627:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976632:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976637:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976642:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976648:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976653:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976668:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976674:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976680:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976684:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976689:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976695:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976701:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976706:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976711:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976716:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976721:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976726:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976731:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976736:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976741:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976795:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976817:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976822:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976828:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976833:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976844:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976850:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976856:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976860:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976865:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976876:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976881:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976885:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976890:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976895:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976900:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976904:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976909:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976915:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976920:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976925:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976930:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976935:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976941:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976946:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976951:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976956:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.976967:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980171:0:6494:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c3aaa42fc00:6494] 1 exiting: rc = 0 00000100:00100000:1.0:1789264270.980280:0:6493:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c3aaa42ea00:6493] 0 exiting: rc = 1 00000100:00100000:3.0:1789264270.980338:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980347:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980353:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980360:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980366:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980372:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980378:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980382:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980388:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980394:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980399:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980406:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980412:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980417:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980422:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980426:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980443:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980448:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980453:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980457:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980471:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980476:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980481:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980486:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980492:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980497:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980501:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980506:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980510:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980515:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980520:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980525:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980530:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980535:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980540:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980545:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980551:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980555:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980560:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980565:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980569:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980574:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980578:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980583:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980587:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980591:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980595:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980599:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980603:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980607:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980612:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980623:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980628:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980632:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980637:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980642:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980647:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980652:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980656:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980671:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980677:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980681:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980686:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264270.980691:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.983206:0:6496:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9c3aaa42f600:6496] 1 exiting: rc = 0 00000100:00100000:3.0:1789264270.983368:0:6495:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9c3aaa42e400:6495] 0 exiting: rc = 1 00000100:00100000:0.0:1789264270.985819:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985831:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985837:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985864:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985881:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985888:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985894:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985899:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985905:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985911:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985917:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985923:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985927:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985932:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985936:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985952:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985958:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985963:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985967:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985971:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985976:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985979:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985983:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985987:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985992:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985995:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.985999:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986013:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986017:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986023:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986028:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986032:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986036:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986040:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986053:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986058:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986062:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986065:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986069:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986087:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986092:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986095:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986099:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986104:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986108:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986112:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986116:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986121:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986125:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986129:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986133:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986146:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986150:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986154:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986158:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986161:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986165:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986168:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986172:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986176:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986180:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986184:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986188:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789264270.986192:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1789264270.997316:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264270.997434:0:6497:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c3aaa42d200:6497] 0 exiting: rc = 1 00000100:00100000:3.0:1789264270.997503:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c3aaa42da00:6498] 1 exiting: rc = 0 00000100:00100000:1.0:1789264270.997582:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997590:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997596:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997601:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997605:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997610:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997615:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997620:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997625:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997630:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997635:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997640:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997646:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997650:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997666:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997671:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997675:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997680:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997684:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997689:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997694:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997699:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997703:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997708:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997713:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997718:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997722:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997727:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997731:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997736:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997741:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997803:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997808:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997813:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997819:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997824:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997828:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997833:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997839:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997843:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997848:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997853:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997857:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997862:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997868:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997873:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997878:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997883:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997888:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997900:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997905:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997909:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997914:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997919:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997925:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997929:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997935:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997940:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997944:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997950:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997955:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997960:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997965:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.997969:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.998497:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c3aaa42d800:6499] 0 exiting: rc = 1 00000100:00100000:0.0:1789264270.998677:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c3aaa42de00:6500] 1 exiting: rc = 0 00000100:00100000:1.0:1789264270.998784:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998790:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998795:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998799:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998804:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998809:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998813:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998818:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998823:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998828:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998832:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998837:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998841:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998846:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998850:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998855:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998859:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998864:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998868:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998873:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998887:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998892:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998897:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998901:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998905:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998910:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998915:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998919:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998924:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998929:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998935:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998940:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998945:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998950:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998955:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998959:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998964:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998969:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998980:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998985:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998989:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998994:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.998999:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999004:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999008:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999013:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999018:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999022:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999027:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999031:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999036:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999040:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999045:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999050:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999055:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999067:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999072:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999077:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999083:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999087:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999092:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999096:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999100:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264270.999104:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264270.999556:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c3ab55fba00:6501] 0 exiting: rc = 1 00000100:00100000:0.0:1789264271.000139:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c3ab55fa600:6502] 1 exiting: rc = 0 00000100:00100000:1.0:1789264271.000450:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000457:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000533:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000538:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000543:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000548:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000553:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000558:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000563:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000568:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000574:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000579:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000584:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000590:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000595:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000600:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000605:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000610:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000615:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000620:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000625:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000630:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000635:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000640:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000644:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000650:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000668:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000672:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000677:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000682:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000686:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000692:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000697:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000702:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000706:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000711:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000716:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000721:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000725:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000730:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000735:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000739:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000955:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000961:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000967:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000972:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.000977:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001341:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001350:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001355:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001361:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001365:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001370:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001374:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001380:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001385:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001390:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001394:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001399:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001404:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001409:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001422:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001427:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.001432:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264271.002534:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9c3ab55faa00:6503] 0 exiting: rc = 1 00000100:00100000:3.0:1789264271.002986:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9c3ab55fbc00:6504] 1 exiting: rc = 0 00000100:00100000:0.0:1789264271.003118:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9c3ab55fa800:6505] 2 exiting: rc = 0 00000100:00100000:1.0:1789264271.003197:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003203:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003223:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003242:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003248:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003253:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003259:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003264:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003271:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003276:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003282:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003290:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003296:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003302:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003307:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003313:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003317:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003323:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003328:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003334:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003338:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003344:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003350:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003355:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003360:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003365:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003370:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003386:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003392:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003397:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003402:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003406:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003420:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003425:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003430:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003435:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003440:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003445:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003450:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003455:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003468:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003474:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003479:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003484:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003489:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003494:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003499:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003503:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003508:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003512:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003517:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003533:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003539:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003544:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003549:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003555:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003559:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003565:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003570:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003575:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003580:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003585:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003590:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264271.003595:0:15417:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789264271.006697:0:15417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789264271.006709:0:15417:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789264271.006715:0:15417:0:(genops.c:885:class_export_put()) final put ffff9c3a8f241000/MDS_uuid 00000020:00000080:1.0:1789264271.006730:0:15417:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3a8f241000/MDS_uuid for MDS 00000020:01000000:1.0:1789264271.006737:0:15417:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789264271.007272:0:15417:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1789264272.009888:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264273.034000:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789264273.418248:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789264273.418258:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789264273.418262:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789264273.418265:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789264273.418287:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c3982013800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789264273.418296:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 348 00000100:00080000:0.0:1789264273.418301:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789264273.418308:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c3982013800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264273.418342:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c39847a6a00 x1876179322809600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789264273.418400:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789264273.418405:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789264273.418407:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa7e1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789264273.418411:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 348 00000100:00080000:0.0:1789264273.418413:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789264273.418417:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c3aaa7e1800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264273.418430:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c39847a4a80 x1876179322809856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789264273.418466:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789264273.418481:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322809984:0@lo:400:kworker.0 00000400:00000100:0.0:1789264273.418530:0:3623:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876179322809984 offset 0 length 224: 4 00000100:00100000:3.0:1789264273.418641:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322809728:0@lo:400:kworker.0 00000400:00000100:3.0:1789264273.418667:0:3625:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876179322809728 offset 0 length 224: 4 00000100:00100000:1.0:1789264273.418790:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1876179322809600:0@lo:38:kworker.0 00000400:00000100:1.0:1789264273.418813:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876179322809600 offset 0 length 520: 4 00000100:00100000:1.0:1789264273.418834:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1876179322809856:0@lo:38:kworker.0 00000400:00000100:1.0:1789264273.418849:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876179322809856 offset 0 length 520: 4 00000020:01000004:1.0:1789264273.787058:0:15618:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789264273.798189:0:15618:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789264273.798256:0:15618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264273.798270:0:15618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264273.798278:0:15618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264273.798285:0:15618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264273.798350:0:15618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789264273.798356:0:15618:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789264273.798379:0:15618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789264273.798390:0:15618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c39847a6a00 x1876179322809600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789264293 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264273.798410:0:15618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789264273.798415:0:15618:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789264273.798422:0:15618:0:(import.c:65:import_set_state_nolock()) ffff9c3982013800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789264273.798426:0:15618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789264273.798430:0:15618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c39847a6a00 x1876179322809600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789264293 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264273.798437:0:15618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789264273.798439:0:15618:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000100:00100000:2.0:1789264273.798495:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1876179322809600:0@lo:38:kworker.0 00000100:00080000:3.0:1789264273.799315:0:15618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789264273.799325:0:15618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c39847a5180 x1876179322809728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264289 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264273.799344:0:15618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789264273.799348:0:15618:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789264273.799366:0:15618:0:(import.c:65:import_set_state_nolock()) ffff9c3982010000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789264273.799459:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322809728:0@lo:400:kworker.0 00000100:00100000:0.0:1789264273.799915:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3621:1876179322810112:0@lo:39:umount.0 00000400:00000100:0.0:1789264273.799966:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876179322810112 offset 0 length 224: 4 00010000:00010000:1.0:1789264273.800251:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264273.800261:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264273.800271:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a80031c00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264273.800275:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264273.800286:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264273.800294:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264273.800300:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789264273.800303:0:7431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789264273.800306:0:7431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789264273.800320:0:7431:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c3a8f246000 00010000:00010000:1.0:1789264273.800324:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xecaf9f2f14ed6c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264273.800330:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a80031c00/0xecaf9f2f14ed6c17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xecaf9f2f14ed6c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264273.800355:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264273.800356:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264273.800358:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264274.058344:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264275.082148:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264276.105974:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789264276.425901:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789264276.425913:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789264276.425916:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789264276.425919:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789264276.426045:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322810240:0@lo:400:kworker.0 00000400:00000100:2.0:1789264276.426104:0:3623:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876179322810240 offset 0 length 224: 4 00000001:00100000:1.0:1789264276.491693:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789264276.491703:0:9482:0:(genops.c:885:class_export_put()) final put ffff9c3abaff1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789264276.492906:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3abaff1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789264276.492956:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3abaff2000 for lustre-OST0001 00000001:00100000:3.0:1789264276.493424:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789264276.493429:0:8398:0:(genops.c:885:class_export_put()) final put ffff9c3982344800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789264276.493551:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3982344800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789264276.493584:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3982346000 for lustre-OST0000 00010000:00010000:3.0:1789264277.130299:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264278.153976:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789264278.473935:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789264278.473946:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789264278.473949:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789264278.473953:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789264278.474115:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322810368:0@lo:400:kworker.0 00000400:00000100:2.0:1789264278.474180:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876179322810368 offset 0 length 224: 4 00010000:00010000:1.0:1789264279.177981:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264280.202016:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264280.970323:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789264270/real 1789264270] req@ffff9c39847a6d80 x1876179322809088/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789264280 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264280.970359:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c39847a6d80 x1876179322809088/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789264280 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789264280.970380:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3a8f246000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789264280.970401:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789264280.970405:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3621:1876179322809088:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1789264280.970476:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789264280.970482:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789264280.970485:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c3a8f246000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789264280.970489:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.144@tcp: connect to NID 0@lo last attempt 351 00000100:00080000:0.0:1789264280.970494:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.144@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789264280.970508:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.144@tcp: import ffff9c3a8f246000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264280.970541:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c39847a7b80 x1876179322810496/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789264280.970564:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789264280.970568:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789264280.970702:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3621:1876179322810496:0@lo:250:kworker.0 00000400:00000100:2.0:1789264280.970769:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876179322810496 offset 0 length 520: 4 00000100:00100000:3.0:1789264280.970838:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1876179322810624:0@lo:400:kworker.0 00000400:00000100:3.0:1789264280.970869:0:3625:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876179322810624 offset 0 length 224: 4 00010000:00010000:2.0:1789264281.226218:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264282.250668:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264283.017861:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789264273/real 1789264273] req@ffff9c3984658700 x1876179322810112/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789264283 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264283.017892:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c3984658700 x1876179322810112/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789264283 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789264283.017910:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3982010000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789264283.017930:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3621:1876179322810112:0@lo:39:umount.0 00000100:00080000:3.0:1789264283.018014:0:15618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789264283.018019:0:15618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789264283.018023:0:15618:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789264283.019193:0:15618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264283.019209:0:15618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264283.019216:0:15618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264283.019223:0:15618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264283.019254:0:15618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789264283.019261:0:15618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6e9b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264283.019266:0:15618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6e9b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264283.019271:0:15618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6e9b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264283.019277:0:15618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6e9b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264283.019359:0:15618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789264283.019365:0:15618:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789264283.019401:0:15618:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789264283.019404:0:15618:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789264283.019408:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789264283.019412:0:15618:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789264283.019416:0:15618:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9c3ab6810000) has no exports 00000020:00080000:3.0:1789264283.019437:0:15618:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9c3ab6810000) has no exports 00010000:00010000:2.0:1789264283.021523:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789264283.021537:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264283.021548:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8f094000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264283.021552:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264283.021561:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264283.021584:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264283.021590:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789264283.021593:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1789264283.021596:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789264283.021687:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264283.021693:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6e9b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264283.021700:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622400 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264283.021703:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6e9b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264283.021710:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6e9b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264283.021716:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6e9b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264283.021721:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789264283.021722:0:6479:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c3a8f246000 00010000:00010000:2.0:1789264283.021726:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xecaf9f2f14ed6c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264283.021729:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789264283.021732:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789264283.021733:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8f094000/0xecaf9f2f14ed6c25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xecaf9f2f14ed6c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264283.021738:0:6478:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c3a8f246000 00010000:00010000:1.0:1789264283.021740:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xecaf9f2f14ed6e9b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264283.021758:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622400/0xecaf9f2f14ed6e94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xecaf9f2f14ed6e9b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264283.021761:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264283.021763:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264283.021765:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264283.021767:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264283.021768:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264283.021769:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789264283.023294:0:15618:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c3abab92000 - data ffff9c3aa9f4c438/ffff9c3abac13000 00000020:01000000:3.0:1789264283.023416:0:15618:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c3abaa4fe40 - data ffff9c3aa9e07510/ffff9c3ab2da9c00 00100000:10000000:3.0:1789264283.032347:0:15618:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789264283.047956:0:15618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6969 00000020:00000080:1.0:1789264283.047968:0:15618:0:(genops.c:885:class_export_put()) final put ffff9c39820dc000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789264283.047983:0:15618:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c3aba913000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789264283.047987:0:15618:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3aba913000 2 00000020:01000004:1.0:1789264283.047990:0:15618:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c3aba913000 from lustre-OST0000 00000020:00000080:1.0:1789264283.048014:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789264283.048024:0:15618:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789264283.048027:0:15618:0:(genops.c:885:class_export_put()) final put ffff9c3aaa7e4000/lustre-OST0000_UUID 00000020:00000080:1.0:1789264283.048029:0:15618:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aaa7e4000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789264283.048036:0:15618:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:0.0:1789264283.048074:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c39820dc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1789264283.048099:0:15618:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789264283.048104:0:15618:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789264283.048107:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789264283.048116:0:15618:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789264283.048123:0:15618:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c3982010800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789264283.048187:0:15618:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9c3982363370) has exports, disconnecting them 00000020:00080000:1.0:1789264283.048193:0:15618:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c3982010800), last request at 1789264102 00000020:00000080:1.0:1789264283.048197:0:15618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6993 00000020:00080000:1.0:1789264283.048206:0:15618:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c3982010800): rc 0 00000020:00000080:1.0:1789264283.048224:0:15618:0:(genops.c:885:class_export_put()) final put ffff9c3982010800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789264283.048281:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3982010800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789264283.053549:0:15618:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789264283.053559:0:15618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789264283.053639:0:15618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789264283.053646:0:15618:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789264283.053955:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3982013800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789264283.055123:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789264283.055144:0:15618:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789264283.055150:0:15618:0:(genops.c:885:class_export_put()) final put ffff9c3982015800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789264283.055155:0:15618:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3982015800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789264283.055161:0:15618:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1789264283.055224:0:15618:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789264283.055228:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789264283.055243:0:15618:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789264283.055250:0:15618:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9c3982017800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789264283.055257:0:15618:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9c39823619b8) has exports, disconnecting them 00000020:00080000:0.0:1789264283.055262:0:15618:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9c3982017800), last request at 1789264102 00000020:00000080:0.0:1789264283.055266:0:15618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed69a8 00000020:00080000:0.0:1789264283.055282:0:15618:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c3982017800): rc 0 00000020:00000080:0.0:1789264283.055287:0:15618:0:(genops.c:885:class_export_put()) final put ffff9c3982017800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789264283.056772:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3982017800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1789264283.057335:0:15618:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789264283.057340:0:15618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789264283.057345:0:15618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789264283.057350:0:15618:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789264283.057371:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3982010000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789264283.057525:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789264283.057543:0:15618:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1789264283.057548:0:15618:0:(genops.c:885:class_export_put()) final put ffff9c3982013000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1789264283.057551:0:15618:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3982013000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1789264283.057556:0:15618:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1789264283.057620:0:15618:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3aba913000 1 00000020:00000080:2.0:1789264283.057626:0:15618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6931 00000020:00000080:2.0:1789264283.057632:0:15618:0:(genops.c:885:class_export_put()) final put ffff9c3abaa53000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789264283.057639:0:15618:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789264283.057646:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3abaa53000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789264283.057654:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789264283.057659:0:15618:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789264283.057662:0:15618:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9c3ab6814d28) has no exports 00000020:00000080:2.0:1789264283.086714:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789264283.086730:0:15618:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789264283.086737:0:15618:0:(genops.c:885:class_export_put()) final put ffff9c3aa9883000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789264283.086741:0:15618:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3aa9883000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789264283.086771:0:15618:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789264283.086884:0:15618:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c3a8f241800 00000020:02000400:2.0:1789264283.087027:0:15618:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789264283.274883:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264284.299253:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264285.322154:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789264285.416150:0:15820:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789264285.428914:0:15820:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789264285.428986:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264285.428999:0:15820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264285.429007:0:15820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264285.429014:0:15820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264285.429030:0:15820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789264285.429035:0:15820:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789264285.429055:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789264285.429064:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c39847a4a80 x1876179322809856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789264293 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264285.429077:0:15820:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789264285.429082:0:15820:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789264285.429089:0:15820:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa7e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789264285.429099:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789264285.429103:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c39847a4a80 x1876179322809856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789264293 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264285.429110:0:15820:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789264285.429113:0:15820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00010000:00010000:1.0:1789264285.429332:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264285.429340:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264285.429348:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264285.429352:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264285.429361:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6c02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264285.429368:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6c02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264285.429373:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789264285.429375:0:7431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789264285.429378:0:7431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789264285.429390:0:7431:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c3a8f246000 00010000:00010000:1.0:1789264285.429394:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xecaf9f2f14ed6c02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264285.429401:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622000/0xecaf9f2f14ed6bfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xecaf9f2f14ed6c02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264285.429411:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264285.429412:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264285.429414:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264285.430321:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1876179322809856:0@lo:38:kworker.0 00000100:00080000:1.0:1789264285.432770:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789264285.432798:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c39847a7100 x1876179322809984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264289 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264285.432819:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c39847a7800 x1876179322810240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264292 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264285.432828:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c3983f52a00 x1876179322810368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264294 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264285.432842:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c39847a5500 x1876179322810624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264296 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264285.432852:0:15820:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789264285.432858:0:15820:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789264285.432878:0:15820:0:(import.c:65:import_set_state_nolock()) ffff9c3aba909800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789264285.432999:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1876179322810368:0@lo:400:kworker.0 00000100:00100000:1.0:1789264285.433141:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1876179322810624:0@lo:400:kworker.0 00000100:00100000:0.0:1789264285.433226:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322810240:0@lo:400:kworker.0 00000100:00100000:2.0:1789264285.433571:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3621:1876179322810752:0@lo:39:umount.0 00000400:00000100:3.0:1789264285.433669:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876179322810752 offset 0 length 224: 4 00000100:00100000:0.0:1789264285.434131:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322809984:0@lo:400:kworker.0 00000100:00080000:2.0:1789264286.217978:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789264286.217988:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789264286.345920:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264287.372198:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264288.393970:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264289.417867:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264290.442008:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789264291.338145:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789264291.338156:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789264291.465993:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264292.489925:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264293.514236:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264294.539209:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264295.562135:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264295.689868:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789264285/real 1789264285] req@ffff9c3983f51880 x1876179322810752/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789264295 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264295.689898:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c3983f51880 x1876179322810752/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789264295 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264295.689909:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789264280/real 1789264280] req@ffff9c39847a7b80 x1876179322810496/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789264295 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264295.689923:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c39847a7b80 x1876179322810496/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789264295 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789264295.689940:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aba909800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789264295.689962:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3621:1876179322810752:0@lo:39:umount.0 00000100:00080000:3.0:1789264295.689969:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3a8f246000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789264295.689997:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789264295.690009:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3621:1876179322810496:0@lo:250:kworker.0 00000100:00080000:0.0:1789264295.690129:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789264295.690134:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789264295.690137:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c3a8f246000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789264295.690142:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.144@tcp: connect to NID 0@lo last attempt 361 00000100:00080000:0.0:1789264295.690147:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.144@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789264295.690154:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.144@tcp: import ffff9c3a8f246000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264295.690183:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c39847a7100 x1876179322810880/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789264295.690271:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789264295.690276:0:15820:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789264295.690281:0:15820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789264295.691146:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264295.691160:0:15820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264295.691182:0:15820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264295.691190:0:15820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264295.691315:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3621:1876179322810880:0@lo:250:kworker.0 00000400:00000100:3.0:1789264295.691365:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876179322810880 offset 0 length 520: 4 00010000:00010000:1.0:1789264295.691455:0:15820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789264295.691465:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed6e8d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264295.691472:0:15820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed6e8d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264295.691479:0:15820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6e8d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264295.691485:0:15820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xecaf9f2f14ed6e8d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264295.691545:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789264295.691553:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264295.691561:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3ab5622800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264295.691565:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264295.691584:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264295.691592:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264295.691598:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789264295.691600:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789264295.691609:0:6478:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c3a8f246000 00010000:00010000:2.0:1789264295.691613:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xecaf9f2f14ed6c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264295.691619:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3ab5622800/0xecaf9f2f14ed6c09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xecaf9f2f14ed6c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264295.691632:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264295.691635:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6e8d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264295.691641:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36be00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264295.691644:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xecaf9f2f14ed6e8d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264295.691649:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6e8d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264295.691656:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6e8d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264295.691671:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789264295.691673:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789264295.691678:0:6478:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c3a8f246000 00010000:00010000:2.0:1789264295.691680:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xecaf9f2f14ed6e8d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264295.691687:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264295.691688:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264295.691690:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264295.691769:0:15820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789264295.691774:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36be00/0xecaf9f2f14ed6e86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xecaf9f2f14ed6e8d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264295.691788:0:15820:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1789264295.691793:0:15820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1789264295.691795:0:15820:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789264295.691820:0:15820:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789264295.691824:0:15820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789264295.691830:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789264295.691841:0:15820:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789264295.691845:0:15820:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9c3aba8eb370) has no exports 00000020:00080000:1.0:1789264295.691868:0:15820:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9c3aba8eb370) has no exports 00000020:01000000:1.0:1789264295.693476:0:15820:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c3abab928a0 - data ffff9c3981c0aaf8/ffff9c3abac10800 00000020:01000000:1.0:1789264295.693637:0:15820:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c3abab2fae0 - data ffff9c3aa9f466c0/ffff9c3abafd6400 00010000:00010000:2.0:1789264295.697401:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789264295.703325:0:15820:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789264295.716557:0:15820:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6a8f 00000020:00000080:1.0:1789264295.716570:0:15820:0:(genops.c:885:class_export_put()) final put ffff9c3983126000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1789264295.716597:0:15820:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c3ab7f50000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1789264295.716600:0:15820:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3ab7f50000 2 00000020:01000004:1.0:1789264295.716603:0:15820:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c3ab7f50000 from lustre-OST0001 00000020:00000080:1.0:1789264295.716632:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789264295.716642:0:15820:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1789264295.716645:0:15820:0:(genops.c:885:class_export_put()) final put ffff9c3982343000/lustre-OST0001_UUID 00000020:00000080:1.0:1789264295.716648:0:15820:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3982343000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1789264295.716655:0:15820:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1789264295.716802:0:15820:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a->MGS 00010000:00010000:1.0:1789264295.716817:0:15820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a813fc000/0xecaf9f2f14ed67e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed67ef expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264295.716829:0:15820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a813fc000/0xecaf9f2f14ed67e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed67ef expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264295.716835:0:15820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789264295.716838:0:15820:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789264295.716842:0:15820:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789264295.716856:0:15820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c3a8f246000 00010000:00010000:1.0:1789264295.716860:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a813fc000/0xecaf9f2f14ed67e8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xecaf9f2f14ed67ef expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789264295.716872:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3983126000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:1.0:1789264295.716876:0:15820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a80031a00/0xecaf9f2f14ed6c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xecaf9f2f14ed6c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264295.716893:0:15820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a80031a00/0xecaf9f2f14ed6c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xecaf9f2f14ed6c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264295.716899:0:15820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789264295.716901:0:15820:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789264295.716903:0:15820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789264295.716919:0:15820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c3a8f246000 00010000:00010000:1.0:1789264295.716922:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a80031a00/0xecaf9f2f14ed6c6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xecaf9f2f14ed6c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789264295.716939:0:15820:0:(import.c:65:import_set_state_nolock()) ffff9c3a8f246000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789264295.716943:0:15820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789264295.716945:0:15820:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789264295.716947:0:15820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789264295.716950:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789264295.716961:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c39847a7100 x1876179322810880/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789264315 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789264295.716973:0:15820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789264295.716975:0:15820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000100:00100000:3.0:1789264295.717060:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91066a17-aaf7-4689-9b8a-2d7c8cfdba8a:3621:1876179322810880:0@lo:250:kworker.0 10000000:01000000:1.0:1789264295.717134:0:15820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789264295.717141:0:15820:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed66e5 00000020:00000080:1.0:1789264295.717146:0:15820:0:(genops.c:885:class_export_put()) final put ffff9c3a8f246800/91066a17-aaf7-4689-9b8a-2d7c8cfdba8a 00000020:01000000:1.0:1789264295.717164:0:15820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.144@tcp (flags='') 00000020:00000080:1.0:1789264295.717169:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789264295.717174:0:15820:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.144@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789264295.717178:0:15820:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9c3aaa494d28) has no exports 10000000:01000000:3.0:1789264295.717231:0:6487:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789264295.717277:0:15820:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.144@tcp: client import never connected 00000100:00080000:1.0:1789264295.717281:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789264295.717283:0:15820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789264295.717286:0:15820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789264295.717294:0:15820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789264295.717323:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789264295.717328:0:15820:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.144@tcp (uuid 91066a17-aaf7-4689-9b8a-2d7c8cfdba8a) 00000020:01000000:1.0:1789264295.717333:0:15820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789264295.717336:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789264295.717340:0:15820:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789264295.717344:0:15820:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c3982017000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789264295.717349:0:15820:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9c39833e19b8) has exports, disconnecting them 00000020:00080000:1.0:1789264295.717353:0:15820:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c3982017000), last request at 1789264116 00000020:00000080:1.0:1789264295.717356:0:15820:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6ab9 00000020:00080000:1.0:1789264295.717366:0:15820:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c3982017000): rc 0 00000020:00000080:1.0:1789264295.717370:0:15820:0:(genops.c:885:class_export_put()) final put ffff9c3982017000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789264295.718144:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3a8f246800/91066a17-aaf7-4689-9b8a-2d7c8cfdba8a for MGC192.168.203.144@tcp 00000020:00000080:2.0:1789264295.718155:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3a8f246000 for MGC192.168.203.144@tcp 00000020:00000080:2.0:1789264295.718161:0:36:0:(genops.c:885:class_export_put()) final put ffff9c3ab2d0e000/91066a17-aaf7-4689-9b8a-2d7c8cfdba8a 00000020:00000080:2.0:1789264295.718163:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ab2d0e000/91066a17-aaf7-4689-9b8a-2d7c8cfdba8a for MGC192.168.203.144@tcp 00000020:01000000:2.0:1789264295.718168:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.144@tcp (91066a17-aaf7-4689-9b8a-2d7c8cfdba8a) 00000020:00000080:2.0:1789264295.718432:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3982017000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789264295.719844:0:15820:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789264295.719850:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789264295.719866:0:15820:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789264295.719872:0:15820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789264295.720045:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789264295.720062:0:15820:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1789264295.720069:0:15820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789264295.720075:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789264295.720079:0:15820:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789264295.720086:0:15820:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9c3ababdd800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789264295.720101:0:15820:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9c39833e4d28) has exports, disconnecting them 00000020:00080000:2.0:1789264295.720106:0:15820:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9c3ababdd800), last request at 1789264116 00000020:00000080:2.0:1789264295.720110:0:15820:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6ace 00000020:00080000:2.0:1789264295.720124:0:15820:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c3ababdd800): rc 0 00000020:00000080:2.0:1789264295.720129:0:15820:0:(genops.c:885:class_export_put()) final put ffff9c3ababdd800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1789264295.720341:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3aaa7e1800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789264295.720348:0:36:0:(genops.c:885:class_export_put()) final put ffff9c3ababdd000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789264295.720351:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ababdd000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789264295.720359:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789264295.720417:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ababdd800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1789264295.722271:0:15820:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789264295.722278:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789264295.722283:0:15820:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789264295.722288:0:15820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789264295.722465:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c3aba909800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1789264295.722773:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789264295.722853:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789264295.723650:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1789264295.723793:0:6474:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c3a8391f400:6474] 1 exiting: rc = 0 00000100:00100000:2.0:1789264295.723869:0:6473:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c3aa024fc00:6473] 0 exiting: rc = 1 00000100:00100000:2.0:1789264295.724615:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.724952:0:6475:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c3ab55f9200:6475] 0 exiting: rc = 1 00000100:00100000:0.0:1789264295.724983:0:6476:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c3ab55f8400:6476] 1 exiting: rc = 0 00000100:00100000:2.0:1789264295.725102:0:7892:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c3aba8da800:7892] 3 exiting: rc = 0 00000100:00100000:2.0:1789264295.725171:0:8420:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9c3982009000:8420] 4 exiting: rc = 0 00000100:00100000:2.0:1789264295.725262:0:6477:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c3ab55f8e00:6477] 2 exiting: rc = 0 00000100:00100000:2.0:1789264295.725314:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.725321:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.725326:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726157:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726164:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726170:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726177:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726183:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726188:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726194:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726200:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726217:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726223:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726230:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726237:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726243:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726258:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726265:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726271:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726276:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726282:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726287:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726292:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726297:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726301:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726306:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726311:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726316:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726321:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726325:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726498:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726507:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726512:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726517:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726522:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726527:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726532:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726537:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726541:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726546:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726550:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726555:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726559:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726564:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726568:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726573:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726585:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726590:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726596:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726601:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726606:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726610:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726615:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726620:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.726624:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.727718:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.727724:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.727728:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.727733:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.727739:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.727759:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.727767:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.727772:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.727777:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789264295.729791:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789264295.729806:0:15820:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1789264295.729813:0:15820:0:(genops.c:885:class_export_put()) final put ffff9c3ababdb000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1789264295.729818:0:15820:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ababdb000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1789264295.729823:0:15820:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1789264295.729877:0:15820:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3ab7f50000 1 00000020:00000080:2.0:1789264295.729885:0:15820:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xecaf9f2f14ed6a5e 00000020:00000080:2.0:1789264295.729891:0:15820:0:(genops.c:885:class_export_put()) final put ffff9c3982341000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789264295.729903:0:15820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789264295.729912:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3982341000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789264295.729923:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789264295.729928:0:15820:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789264295.729932:0:15820:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9c3ab6920000) has no exports 00000020:00000080:3.0:1789264295.780318:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789264295.780332:0:15820:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789264295.780337:0:15820:0:(genops.c:885:class_export_put()) final put ffff9c3ab690a800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789264295.780341:0:15820:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3ab690a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789264295.780347:0:15820:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789264295.780697:0:15820:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c39820d2800 00000020:01000000:3.0:1789264295.780716:0:15820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789264295.780720:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789264295.780724:0:15820:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789264295.780729:0:15820:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9c3aba8e8000) has no exports 00000020:00000080:3.0:1789264295.780785:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789264295.780791:0:15820:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789264295.780793:0:15820:0:(genops.c:885:class_export_put()) final put ffff9c3abaa55800/OSS_uuid 00000020:00000080:3.0:1789264295.780795:0:15820:0:(genops.c:844:class_export_destroy()) destroying export ffff9c3abaa55800/OSS_uuid for OSS 00000020:01000000:3.0:1789264295.780799:0:15820:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1789264295.780967:0:6486:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789264295.781242:0:8403:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9c3aba8dce00:8403] 0 exiting: rc = 1 00000100:00100000:0.0:1789264295.781242:0:11052:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9c39834a7400:11052] 4 exiting: rc = 0 00000100:00100000:3.0:1789264295.781335:0:10317:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9c3982309600:10317] 3 exiting: rc = 0 00000100:00100000:2.0:1789264295.781393:0:8405:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9c3aba8dd800:8405] 1 exiting: rc = 0 00000100:00100000:1.0:1789264295.781446:0:8406:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9c3aba8dde00:8406] 2 exiting: rc = 0 00000100:00100000:3.0:1789264295.781618:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781629:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781637:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781642:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781655:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781660:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781664:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781669:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781674:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781679:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781683:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781688:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781693:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781698:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781703:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781707:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781713:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781718:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781722:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781727:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781733:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.781738:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782006:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782013:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782018:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782023:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782027:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782032:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782037:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782041:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782046:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782062:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782067:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782071:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782076:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782081:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782086:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782091:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782096:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782110:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782115:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782120:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782125:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782131:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782136:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782140:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782145:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782151:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782158:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782162:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782166:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782171:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782177:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782181:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782186:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782191:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782196:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782201:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782206:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782211:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782216:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782221:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782226:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.782241:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.783680:0:8407:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c3ab7f3de00:8407] 0 exiting: rc = 1 00000100:00100000:1.0:1789264295.783782:0:8408:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c3abb223400:8408] 1 exiting: rc = 0 00000100:00100000:0.0:1789264295.783786:0:11925:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9c3983758400:11925] 2 exiting: rc = 0 00000100:00100000:3.0:1789264295.784062:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784070:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784079:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784084:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784089:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784094:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784099:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784104:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784109:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784114:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784133:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784138:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784143:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784153:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784160:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784165:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784171:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784176:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784181:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784186:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784191:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784195:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784200:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784205:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.784210:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785099:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785107:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785112:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785117:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785122:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785128:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785133:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785138:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785143:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785148:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785153:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785159:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785164:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785169:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785174:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785179:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785184:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785189:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785193:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785198:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785210:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785215:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785220:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785225:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785230:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785235:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785240:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785245:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785250:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785255:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785261:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785266:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785271:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785276:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785280:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785285:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785290:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785295:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.785303:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.786694:0:8409:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c3aba8dae00:8409] 0 exiting: rc = 1 00000100:00100000:1.0:1789264295.786837:0:8410:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c3aba961600:8410] 1 exiting: rc = 0 00000100:00100000:0.0:1789264295.788095:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c3abb223c00:8411] 2 exiting: rc = 0 00000100:00100000:3.0:1789264295.790280:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790291:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790296:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790301:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790306:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790311:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790316:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790321:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790327:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790332:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790338:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790343:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790348:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790353:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790357:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790374:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790398:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790404:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790409:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790414:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790420:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790425:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790430:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790436:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790441:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790446:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790451:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790456:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790461:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790465:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790470:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790475:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790480:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790484:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790489:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790495:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790500:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790505:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790579:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790588:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790607:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790614:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790619:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790625:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790631:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790636:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790642:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790648:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790654:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790659:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790672:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790677:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790682:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790688:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790693:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790699:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790707:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790713:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790718:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790724:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790729:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790735:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790740:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.790789:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789264295.795110:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c3aba961200:8412] 0 exiting: rc = 1 00000100:00100000:3.0:1789264295.795934:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c3a8f39ae00:8413] 1 exiting: rc = 0 00000100:00100000:2.0:1789264295.796105:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796113:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796118:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796123:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796128:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796134:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796139:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796143:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796148:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796163:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796170:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796175:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796180:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796185:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796190:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796196:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796201:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796206:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796211:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796217:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796223:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796228:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796233:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796238:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796243:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796248:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796253:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796258:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796274:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796281:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796288:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796293:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796302:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796310:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796329:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796334:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796339:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796344:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796348:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796354:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796359:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796370:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796377:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796384:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796388:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796393:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796398:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796402:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796407:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796411:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796416:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796421:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796426:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796431:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796435:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796439:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796444:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796448:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796452:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796457:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796464:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796469:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796474:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.796480:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789264295.797622:0:8415:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c3abaf81000:8415] 1 exiting: rc = 0 00000100:00100000:1.0:1789264295.797794:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c3abaf80000:8414] 0 exiting: rc = 1 00000100:00100000:2.0:1789264295.798422:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798439:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798445:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798451:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798457:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798474:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798481:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798486:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798491:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798497:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798517:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798524:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798530:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798536:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798542:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798548:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798553:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798558:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798564:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798570:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798576:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798582:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798603:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798610:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798616:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798624:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798634:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798641:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798647:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798653:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798659:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798665:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798670:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798676:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798694:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798700:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798706:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798711:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798718:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798724:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798736:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798742:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798765:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798774:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798781:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798788:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798812:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798821:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798826:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798831:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798837:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798843:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798849:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798854:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798860:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798865:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798870:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798875:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798895:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798903:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798912:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798918:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798926:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789264295.798944:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789264295.811225:0:15820:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789264309.433517:0:16584:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789264317.239041:0:17183:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789264317.239046:0:17183:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789264317.239048:0:17183:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789264317.239216:0:17183:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c3983f5f000 00000020:01000004:1.0:1789264317.239232:0:17183:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789264317.239240:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789264317.239253:0:17183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c39833e0000) 00000020:00000080:1.0:1789264317.239337:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789264317.297207:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.301201:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789264317.302619:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1789264317.303218:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.303419:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.303711:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.303947:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.304285:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.304488:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.304723:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.305072:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.305394:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.305626:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.305897:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.306077:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.306368:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.306668:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.306932:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.307313:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.307572:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.307926:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.308293:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.308537:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.308768:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.309003:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.309455:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.309778:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.310123:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.310410:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.310602:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.310826:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.311068:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.311443:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.311696:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789264317.312031:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1789264317.314729:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1789264317.315313:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789264317.315699:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789264317.316187:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789264317.316661:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789264317.316942:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789264317.317333:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789264317.317614:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789264317.317819:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789264317.318112:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789264317.318444:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789264317.318767:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789264317.320530:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789264317.320971:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789264317.321283:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789264317.322234:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789264317.322694:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1789264317.322913:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1789264317.323432:0:17183:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789264317.323704:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789264317.323712:0:17183:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789264317.323723:0:17183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed7ca2 00000020:01000004:2.0:1789264317.323730:0:17183:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789264317.323735:0:17183:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789264317.323740:0:17183:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c3983f5f000 from MGS 00000020:01000004:2.0:1789264317.323848:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789264317.323859:0:17183:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c3ab6924d28) 00000020:00000080:2.0:1789264317.323872:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789264317.323945:0:17183:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3983f5f000 from MGS, refs=2 00080000:01000000:2.0:1789264317.323950:0:17183:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789264317.323955:0:17183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed7cb0 00000100:00100000:2.0:1789264317.324048:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789264317.324375:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789264317.324382:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789264317.328480:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789264317.328501:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789264317.329727:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789264317.329970:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789264317.329976:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789264317.331557:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789264317.331570:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789264317.332234:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789264317.332248:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789264317.333616:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264317.333622:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264317.333623:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264317.333965:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264317.333968:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264317.333970:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264317.334533:0:17183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789264317.336191:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789264317.340433:0:17183:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789264317.341382:0:17195:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789264317.341433:0:17183:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789264317.341466:0:17183:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789264317.342112:0:17183:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789264317.342427:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789264317.342700:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789264317.342706:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789264317.346047:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789264317.346064:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789264317.347994:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789264317.348005:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789264317.348720:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789264317.348774:0:17183:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.144@tcp' 00000020:01000004:3.0:1789264317.348777:0:17183:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789264317.348804:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.144@tcp (typ=mgc) 00000020:00000080:3.0:1789264317.348816:0:17183:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.144@tcp (ffff9c3aba8e8000) 00000020:00000080:3.0:1789264317.348829:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789264317.348959:0:17183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3983cea000@MGC192.168.203.144@tcp: add connection 192.168.203.144@tcp at head 00010000:00010000:3.0:1789264317.349095:0:17183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.144@tcp-0 is initialized 00000040:01000000:3.0:1789264317.349101:0:17183:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789264317.349639:0:17200:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789264317.353187:0:17201:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789264317.353271:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.144@tcp (uuid 33d0f4c0-a3be-407d-95bb-bba0d070d9d9) 00000020:00000080:3.0:1789264317.353296:0:17183:0:(genops.c:1385:class_connect()) connect: client 33d0f4c0-a3be-407d-95bb-bba0d070d9d9, cookie 0xecaf9f2f14ed7cbe 00000100:00080000:3.0:1789264317.353309:0:17183:0:(import.c:510:import_select_connection()) MGC192.168.203.144@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789264317.353317:0:17183:0:(import.c:624:import_select_connection()) MGC192.168.203.144@tcp: import ffff9c3983cea000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1789264317.353351:0:17183:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3984658a80 x1876179322811008/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789264317.353389:0:17183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 33d0f4c0-a3be-407d-95bb-bba0d070d9d9->MGS 00000020:01000004:3.0:1789264317.353418:0:17183:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789264317.353423:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789264317.353437:0:17183:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c3aba8eb370) 00000020:00000080:3.0:1789264317.353449:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789264317.358119:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3621:1876179322811008:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789264317.358188:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264317.358274:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322811008 00000100:00100000:2.0:1789264317.358281:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322811008 00000100:00100000:2.0:1789264317.358327:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789264317.358334:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a9250d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3621:x1876179322811008:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789264317.358359:0:17196:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 33d0f4c0-a3be-407d-95bb-bba0d070d9d9@0@lo t0 exp 0000000000000000 cur 397 last 0 00000020:00000080:2.0:1789264317.358385:0:17196:0:(genops.c:1385:class_connect()) connect: client 33d0f4c0-a3be-407d-95bb-bba0d070d9d9, cookie 0xecaf9f2f14ed7ccc 00000100:00080000:2.0:1789264317.358516:0:17196:0:(import.c:65:import_set_state_nolock()) ffff9c3983372000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789264317.358566:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a9250d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+5:3621:x1876179322811008:12345-0@lo:250:mount.lustre.0 Request processed in 230us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264317.358573:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789264317.358616:0:3621:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.144@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789264317.358624:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.144@tcp: connect to target with instance 0 00000100:00080000:2.0:1789264317.358631:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.144@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789264317.358636:0:3621:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789264317.358638:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3983cea000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789264317.358641:0:3621:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789264317.358648:0:3621:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789264317.358652:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3621:1876179322811008:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789264317.366157:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789264317.366336:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789264317.366342:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789264317.367136:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789264317.367145:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789264317.367494:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789264317.367572:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789264317.368366:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789264317.368614:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789264317.368620:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789264317.369101:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789264317.369107:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789264317.395985:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789264317.396198:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789264317.396204:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789264317.397317:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789264317.397325:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789264317.398042:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789264317.398199:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789264317.398203:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789264317.398850:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789264317.398858:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789264317.399333:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789264317.399482:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789264317.399487:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789264317.400060:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789264317.400067:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789264317.400716:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789264317.401027:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789264317.401032:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789264317.401452:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789264317.401458:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789264317.414695:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789264317.415045:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789264317.415052:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789264317.416160:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789264317.416171:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789264317.417048:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789264317.417058:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789264317.417999:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789264317.418028:0:17183:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789264317.418035:0:17183:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789264317.418127:0:17183:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789264317.418161:0:17183:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.144@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789264317.418165:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789264317.418166:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789264317.418167:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789264317.418169:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789264317.418170:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789264317.418171:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789264317.418173:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789264317.418175:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789264317.418177:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789264317.418178:0:17183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789264317.418181:0:17183:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789264317.418183:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789264317.418185:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789264317.418186:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789264317.418187:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789264317.418188:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789264317.418189:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789264317.418190:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789264317.418191:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789264317.418192:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789264317.418193:0:17183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789264317.418217:0:17183:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789264317.418235:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322811136:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789264317.418311:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264317.418405:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264317.418489:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322811136 00000100:00100000:0.0:1789264317.418567:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322811136 00000100:00100000:0.0:1789264317.418653:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789264317.418662:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a9250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+5:17183:x1876179322811136:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789264317.418703:0:17199:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789264317.418706:0:17199:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789264317.418708:0:17199:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789264317.419031:0:17219:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789264317.419413:0:17199:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1789264317.420477:0:17220:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789264317.420482:0:17220:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1789264317.420485:0:17220:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789264317.420488:0:17220:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789264317.420705:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1789264317.420963:0:17199:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789264317.420971:0:17199:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789264317.422406:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a9250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+5:17183:x1876179322811136:12345-0@lo:253:mount.lustre.0 Request processed in 3737us (4087us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.422424:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789264317.422575:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322811136:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789264317.422591:0:17183:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789264317.422594:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789264317.422596:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789264317.422597:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789264317.422598:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789264317.422600:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789264317.422601:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789264317.422603:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789264317.422605:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789264317.422606:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789264317.422608:0:17183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789264317.422626:0:17183:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c3983f5f000 from lustre-MDT0000 10000000:01000000:3.0:1789264317.422654:0:17183:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789264317.422656:0:17183:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789264317.422660:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c3aba8e8000 10000000:01000000:3.0:1789264317.422664:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789264317.422671:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c3aba8e8000 from 1 10000000:01000000:3.0:1789264317.422679:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789264317.422713:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264317.422722:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264317.422731:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264317.422815:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322811264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789264317.422851:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264317.422920:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8811f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789264317.422957:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322811264 00000100:00100000:0.0:1789264317.422963:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322811264 00000100:00100000:0.0:1789264317.423045:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264317.423055:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+5:17183:x1876179322811264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789264317.423074:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264317.423086:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c39836cbc00/0xecaf9f2f14ed7cda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7cd3 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.423105:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c39836cbc00/0xecaf9f2f14ed7cda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7cd3 expref: 6 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.423115:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c39836cbc00/0xecaf9f2f14ed7cda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7cd3 expref: 6 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.423122:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836cbc00, rc 0) 00000100:00100000:0.0:1789264317.423188:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+6:17183:x1876179322811264:12345-0@lo:101:mount.lustre.0 Request processed in 136us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264317.423194:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789264317.423261:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322811264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789264317.423273:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cda expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264317.423281:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7cda expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264317.423340:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322811392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789264317.423363:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264317.423383:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8811f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.423431:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322811392 00000100:00100000:1.0:1789264317.423435:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322811392 00000100:00100000:1.0:1789264317.423464:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789264317.423470:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+6:17183:x1876179322811392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264317.423551:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+6:17183:x1876179322811392:12345-0@lo:501:mount.lustre.0 Request processed in 81us (187us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789264317.423557:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789264317.423705:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322811392:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789264317.423731:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789264317.423773:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cda expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264317.423793:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cda expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264317.423801:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c3983f5f000 10000000:01000000:3.0:1789264317.423805:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789264317.423810:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c3983f5f000 10000000:01000000:3.0:1789264317.423813:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789264317.423815:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c3983f5f000 from 1 10000000:01000000:3.0:1789264317.423818:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789264317.423835:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed7ce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264317.423842:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed7ce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264317.423850:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed7ce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264317.423862:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322811520:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789264317.423888:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264317.423913:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8811f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.423999:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322811520 00000100:00100000:1.0:1789264317.424003:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322811520 00000100:00100000:1.0:1789264317.424065:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789264317.424072:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+6:17183:x1876179322811520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789264317.424080:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264317.424092:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed7ce8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7ce1 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.424105:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed7ce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7ce1 expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.424114:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3983e45e00/0xecaf9f2f14ed7ce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7ce1 expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.424121:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45e00, rc 0) 00000100:00100000:1.0:1789264317.424159:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+7:17183:x1876179322811520:12345-0@lo:101:mount.lustre.0 Request processed in 88us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.424165:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789264317.424265:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322811520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789264317.424276:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed7ce1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7ce8 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264317.424283:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed7ce1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7ce8 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264317.424305:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789264317.424324:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed7ce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7ce8 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264317.424331:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36ae00/0xecaf9f2f14ed7ce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7ce8 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264317.424336:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789264317.424340:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789264317.424344:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c3983f5f000 10000000:01000000:3.0:1789264317.424346:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789264317.424349:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789264317.424351:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789264317.424364:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed7cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264317.424371:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed7cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264317.424380:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed7cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264317.424393:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322811648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789264317.424419:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264317.424478:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8811f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.424607:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322811648 00000100:00100000:1.0:1789264317.424612:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322811648 00000100:00100000:1.0:1789264317.424640:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789264317.424647:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+7:17183:x1876179322811648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789264317.424661:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264317.424669:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3983e44000/0xecaf9f2f14ed7cf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7cef expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.424684:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e44000/0xecaf9f2f14ed7cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7cef expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.424693:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3983e44000/0xecaf9f2f14ed7cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7cef expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.424699:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44000, rc 0) 00000100:00100000:1.0:1789264317.424736:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+8:17183:x1876179322811648:12345-0@lo:101:mount.lustre.0 Request processed in 89us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.424777:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789264317.424932:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322811648:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789264317.424943:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed7cef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cf6 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264317.424956:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed7cef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7cf6 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264317.425000:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322811776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789264317.425027:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264317.425054:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8811f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789264317.425101:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322811776 00000100:00100000:0.0:1789264317.425106:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322811776 00000100:00100000:0.0:1789264317.425130:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789264317.425136:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+8:17183:x1876179322811776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789264317.425263:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+9:17183:x1876179322811776:12345-0@lo:501:mount.lustre.0 Request processed in 127us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264317.425270:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789264317.425340:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322811776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789264317.425364:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322811904:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789264317.425400:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264317.425424:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8811f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789264317.425470:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322811904 00000100:00100000:0.0:1789264317.425474:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322811904 00000100:00100000:0.0:1789264317.425492:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264317.425509:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+9:17183:x1876179322811904:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789264317.426165:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+9:17183:x1876179322811904:12345-0@lo:503:mount.lustre.0 Request processed in 664us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264317.426181:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789264317.426267:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322811904:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789264317.426677:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17221:1876179322812032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264317.426712:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264317.426740:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8811f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789264317.426896:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322812032 00000100:00100000:0.0:1789264317.426911:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322812032 00000100:00100000:0.0:1789264317.426946:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264317.426954:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+9:17221:x1876179322812032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264317.427481:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+9:17221:x1876179322812032:12345-0@lo:502:llog_process_th.0 Request processed in 526us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264317.427488:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789264317.427615:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17221:1876179322812032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789264317.427644:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264317.427655:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264317.427657:0:17221:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789264317.427663:0:17221:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789264317.427665:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789264317.427679:0:17221:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c3aba8ecd28) 00000020:00000080:3.0:1789264317.427693:0:17221:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789264317.427698:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789264317.427799:0:17221:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789264317.427806:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed7d04 00000020:00000080:3.0:1789264317.428017:0:17221:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789264317.428022:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264317.428025:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264317.428027:0:17221:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789264317.428029:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264317.428033:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264317.428034:0:17221:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789264317.428037:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789264317.428044:0:17221:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c3aba8e99b8) 00000020:00000080:3.0:1789264317.428052:0:17221:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789264317.428056:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789264317.428058:0:17221:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789264317.428060:0:17221:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789264317.428066:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789264317.428107:0:17221:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3983f5f000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789264317.428120:0:17221:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c3aaa494d28) 00000020:00000080:3.0:1789264317.428128:0:17221:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789264317.428190:0:17221:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789264317.428196:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xecaf9f2f14ed7d19 00000020:00000080:3.0:1789264317.428283:0:17221:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789264317.428288:0:17221:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789264317.428291:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xecaf9f2f14ed7d20 00080000:01000000:3.0:1789264317.428296:0:17221:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789264317.428298:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed7d27 00010000:00010000:2.0:1789264317.487972:0:17221:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789264317.488400:0:17221:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1789264317.488735:0:17221:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789264317.489380:0:17221:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c3ab69219b8) 00000020:00000080:2.0:1789264317.489400:0:17221:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789264317.489488:0:17221:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789264317.489495:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed7d35 00000020:00000080:0.0:1789264317.490059:0:17221:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789264317.495942:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xecaf9f2f14ed7d3c 00000020:00000080:2.0:1789264317.498514:0:17221:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789264317.498527:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264317.498534:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264317.498536:0:17221:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789264317.498540:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789264317.498542:0:17221:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1789264317.498544:0:17221:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789264317.498545:0:17221:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789264317.498547:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789264317.498549:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264317.498550:0:17221:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789264317.498553:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264317.498557:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264317.498558:0:17221:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789264317.498562:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789264317.498607:0:17221:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789264317.498625:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264317.498628:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264317.498630:0:17221:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789264317.498632:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264317.498635:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264317.498636:0:17221:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789264317.498639:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789264317.498644:0:17221:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:00000080:2.0:1789264317.498677:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789264317.498691:0:17221:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c3ab6923370) 00000020:00000080:2.0:1789264317.498706:0:17221:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789264317.498711:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789264317.498795:0:17221:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789264317.498800:0:17221:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789264317.498807:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed7d4a 00010000:00080000:2.0:1789264317.498849:0:17221:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c39835f1800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:2.0:1789264317.500381:0:17221:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789264317.501415:0:17221:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789264317.501427:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789264317.501458:0:17221:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789264317.501476:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xecaf9f2f14ed7d51 00000100:00080000:1.0:1789264317.501486:0:17221:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789264317.501492:0:17221:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c39835f1800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264317.501592:0:17221:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f50e00 x1876179322812160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789264317.501652:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322812160:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789264317.501719:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264317.501854:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322812160 00000100:00100000:0.0:1789264317.501861:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322812160 00000100:00100000:0.0:1789264317.501894:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789264317.501901:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1876179322812160:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1789264317.501926:0:17208:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1789264317.505037:0:17221:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1789264317.505161:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264317.505169:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264317.505171:0:17221:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789264317.505174:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789264317.505177:0:17221:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1789264317.505178:0:17221:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789264317.505192:0:17221:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789264317.505193:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789264317.505196:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264317.505198:0:17221:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789264317.505200:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789264317.505204:0:17221:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789264317.505208:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264317.505209:0:17221:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789264317.505212:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789264317.505216:0:17221:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:1.0:1789264317.505240:0:17221:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789264317.505242:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789264317.505256:0:17221:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c39833e3370) 00000020:00000080:1.0:1789264317.505276:0:17221:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789264317.505280:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789264317.505364:0:17221:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789264317.505369:0:17221:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789264317.505377:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed7d5f 00010000:00080000:1.0:1789264317.505406:0:17221:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3aaa1e5800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:1.0:1789264317.505627:0:17221:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789264317.506589:0:17221:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789264317.506822:0:17221:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789264317.508290:0:17221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789264317.508934:0:17221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789264317.514971:0:17221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789264317.517900:0:17227:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789264317.517917:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1789264317.524481:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1876179322812160:12345-0@lo:38:llog_process_th.0 Request processed in 22570us (22752us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789264317.524505:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789264317.524662:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c39835f1800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789264317.524668:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789264317.524672:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322812160:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1789264317.525032:0:17221:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789264317.525045:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789264317.525087:0:17221:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789264317.525108:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xecaf9f2f14ed7d66 00000100:00080000:1.0:1789264317.525115:0:17221:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789264317.525120:0:17221:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c3aaa1e5800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264317.525147:0:17221:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f50700 x1876179322812288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789264317.525180:0:17221:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789264317.525230:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264317.525234:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264317.525236:0:17221:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789264317.525238:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789264317.525241:0:17221:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789264317.525242:0:17221:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789264317.525244:0:17221:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789264317.525245:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789264317.525247:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264317.525249:0:17221:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789264317.525251:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789264317.525255:0:17221:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789264317.525258:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264317.525260:0:17221:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789264317.525263:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789264317.525266:0:17221:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:1.0:1789264317.525286:0:17221:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789264317.525288:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789264317.525298:0:17221:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c39833e4d28) 00000020:00000080:1.0:1789264317.525309:0:17221:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1789264317.525313:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789264317.525365:0:17221:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789264317.525372:0:17221:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789264317.525377:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xecaf9f2f14ed7d74 00010000:00080000:1.0:1789264317.525403:0:17221:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3aba916800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.144@tcp at head 00000100:00100000:2.0:1789264317.525637:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322812288:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789264317.525675:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876179322812288 offset 0 length 520: 4 00010000:00010000:1.0:1789264317.525942:0:17221:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789264317.526005:0:17221:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789264317.526017:0:17221:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789264317.527189:0:17221:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 0, last_idx 1 00000040:00080000:1.0:1789264317.527913:0:17221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789264317.528117:0:17221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789264317.528238:0:17221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789264317.528695:0:17229:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:2.0:1789264317.528700:0:17229:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789264317.530286:0:17221:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789264317.530298:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789264317.530332:0:17221:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789264317.530350:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xecaf9f2f14ed7d7b 00000100:00080000:1.0:1789264317.530360:0:17221:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789264317.530366:0:17221:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c3aba916800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264317.530398:0:17221:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f51c00 x1876179322812416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789264317.530460:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322812416:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789264317.530630:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876179322812416 offset 0 length 520: 4 00000100:00080000:1.0:1789264317.530812:0:17221:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789264317.530869:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264317.530873:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264317.530875:0:17221:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789264317.530878:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789264317.530881:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264317.530882:0:17221:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789264317.530885:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789264317.530888:0:17221:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789264317.530889:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264317.530892:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264317.530893:0:17221:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789264317.530895:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789264317.530897:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264317.530898:0:17221:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789264317.530910:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789264317.530940:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17221:1876179322812544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264317.530993:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264317.531021:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322812544 00000100:00100000:1.0:1789264317.531026:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322812544 00000100:00100000:1.0:1789264317.531058:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789264317.531072:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+9:17221:x1876179322812544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264317.531165:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+9:17221:x1876179322812544:12345-0@lo:502:llog_process_th.0 Request processed in 94us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.531173:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789264317.531213:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983784300 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.531231:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17221:1876179322812544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789264317.531254:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264317.531258:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264317.531259:0:17221:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789264317.531262:0:17221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789264317.531308:0:17183:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789264317.531324:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789264317.531337:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed7cef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cf6 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.531346:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a000/0xecaf9f2f14ed7cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cf6 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264317.531354:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c3983f5f000 from 1 10000000:01000000:1.0:1789264317.531356:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789264317.531380:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.531388:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.531397:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264317.531419:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322812672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789264317.531446:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264317.531462:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983784300 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.531479:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322812672 00000100:00100000:1.0:1789264317.531482:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322812672 00000100:00100000:1.0:1789264317.531518:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789264317.531525:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+9:17183:x1876179322812672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789264317.531533:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264317.531546:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7d89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7d82 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.531566:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7d82 expref: 10 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.531577:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7d82 expref: 10 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.531586:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44a00, rc 0) 00000100:00100000:1.0:1789264317.531613:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+10:17183:x1876179322812672:12345-0@lo:101:mount.lustre.0 Request processed in 88us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.531619:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789264317.531650:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322812672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789264317.531660:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7d89 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.531669:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7d89 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264317.532234:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322812800:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789264317.532273:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264317.532290:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983784300 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.532308:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322812800 00000100:00100000:1.0:1789264317.532312:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322812800 00000100:00100000:1.0:1789264317.532335:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789264317.532341:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+10:17183:x1876179322812800:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789264317.532354:0:17196:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789264317.532359:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789264317.532419:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+10:17183:x1876179322812800:12345-0@lo:256:mount.lustre.0 Request processed in 77us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.532426:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789264317.532460:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322812800:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789264317.533014:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789264317.533023:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7d89 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.533033:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7d89 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264317.533040:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3983f5f000 from 1 10000000:01000000:1.0:1789264317.533043:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789264317.533065:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.533073:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.533090:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264317.533104:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322812928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789264317.533131:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264317.533146:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983784300 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.533163:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322812928 00000100:00100000:1.0:1789264317.533167:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322812928 00000100:00100000:1.0:1789264317.533189:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789264317.533195:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+10:17183:x1876179322812928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789264317.533203:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264317.533213:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed7d97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7d90 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.533230:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed7d97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7d90 expref: 11 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.533240:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed7d97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7d90 expref: 11 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.533247:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45200, rc 0) 00000100:00100000:1.0:1789264317.533273:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+11:17183:x1876179322812928:12345-0@lo:101:mount.lustre.0 Request processed in 78us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.533279:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789264317.533313:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322812928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789264317.533324:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7d97 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.533339:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7d97 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264317.533387:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322813056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264317.533411:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264317.533424:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983784300 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.533436:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322813056 00000100:00100000:1.0:1789264317.533440:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322813056 00000100:00100000:1.0:1789264317.533460:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789264317.533465:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8920b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+11:17183:x1876179322813056:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264317.533590:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8920b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+11:17183:x1876179322813056:12345-0@lo:501:mount.lustre.0 Request processed in 124us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.533597:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789264317.533630:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322813056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264317.533656:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322813184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789264317.533693:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264317.533704:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983784300 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.533717:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322813184 00000100:00100000:1.0:1789264317.533721:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322813184 00000100:00100000:1.0:1789264317.533764:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789264317.533772:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a89209050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+11:17183:x1876179322813184:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789264317.533847:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a89209050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+11:17183:x1876179322813184:12345-0@lo:503:mount.lustre.0 Request processed in 75us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.533853:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789264317.533900:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322813184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789264317.537448:0:17231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983621180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17231:1876179322813312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789264317.537598:0:17231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264317.537671:0:17231:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa1b5300 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.537706:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322813312 00000100:00100000:1.0:1789264317.537713:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322813312 00000100:00100000:1.0:1789264317.537959:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789264317.537970:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a89208450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+11:17231:x1876179322813312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264317.538432:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a89208450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+11:17231:x1876179322813312:12345-0@lo:502:llog_process_th.0 Request processed in 463us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.538440:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789264317.538539:0:17231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17231:1876179322813312:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789264317.538568:0:17231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264317.538577:0:17231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264317.538580:0:17231:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789264317.538586:0:17231:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c3983f5f000 00000020:00000080:3.0:1789264317.538594:0:17231:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789264317.538603:0:17231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264317.538606:0:17231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264317.538607:0:17231:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789264317.538610:0:17231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264317.538612:0:17231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264317.538613:0:17231:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789264317.538617:0:17231:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c3983f5f000 00000020:00000080:3.0:1789264317.538619:0:17231:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789264317.538676:0:17231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264317.538680:0:17231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264317.538681:0:17231:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789264317.538684:0:17231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264317.538686:0:17231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264317.538688:0:17231:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789264317.538691:0:17231:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c3983f5f000 00000020:00000080:3.0:1789264317.538693:0:17231:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789264317.538710:0:17231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264317.538713:0:17231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264317.538714:0:17231:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789264317.538716:0:17231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264317.538719:0:17231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264317.538720:0:17231:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789264317.538723:0:17231:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c3983f5f000 00000020:00000080:3.0:1789264317.538726:0:17231:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789264317.538784:0:17231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17231:1876179322813440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264317.538822:0:17231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264317.542667:0:17231:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8811f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264317.545612:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322813440 00000100:00100000:2.0:1789264317.545626:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322813440 00000100:00100000:2.0:1789264317.545676:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789264317.545686:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a89208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+11:17231:x1876179322813440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789264317.545894:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a89208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+11:17231:x1876179322813440:12345-0@lo:502:llog_process_th.0 Request processed in 210us (7071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264317.545913:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789264317.546054:0:17231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17231:1876179322813440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789264317.546094:0:17231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264317.546102:0:17231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264317.546108:0:17231:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789264317.546113:0:17231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789264317.546404:0:17183:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789264317.546424:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789264317.546442:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7d97 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.546453:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7d97 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264317.546577:0:17183:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789264317.546580:0:17183:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c3983f5f000 10000000:01000000:1.0:1789264317.546583:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c3983f5f000 10000000:01000000:1.0:1789264317.546587:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789264317.546592:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3983f5f000 from 1 10000000:01000000:1.0:1789264317.546594:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789264317.546623:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3983e45600/0xecaf9f2f14ed7d9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.546632:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3983e45600/0xecaf9f2f14ed7d9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.546641:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3983e45600/0xecaf9f2f14ed7d9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264317.546668:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322813568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789264317.546707:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264317.546764:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983784f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.546780:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322813568 00000100:00100000:1.0:1789264317.546784:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322813568 00000100:00100000:1.0:1789264317.546804:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789264317.546811:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a89209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+11:17183:x1876179322813568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789264317.546821:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264317.546833:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3983e44e00/0xecaf9f2f14ed7da5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7d9e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.546853:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e44e00/0xecaf9f2f14ed7da5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7d9e expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.546864:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3983e44e00/0xecaf9f2f14ed7da5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7d9e expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.546872:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44e00, rc 0) 00000100:00100000:1.0:1789264317.546911:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a89209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17183:x1876179322813568:12345-0@lo:101:mount.lustre.0 Request processed in 91us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.546917:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789264317.546948:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322813568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789264317.546961:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3983e45600/0xecaf9f2f14ed7d9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7da5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.546971:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3983e45600/0xecaf9f2f14ed7d9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7da5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264317.547025:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322813696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264317.547051:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264317.547060:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983784f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.547078:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322813696 00000100:00100000:1.0:1789264317.547082:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322813696 00000100:00100000:1.0:1789264317.547099:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789264317.547105:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17183:x1876179322813696:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264317.547208:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17183:x1876179322813696:12345-0@lo:501:mount.lustre.0 Request processed in 102us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.547216:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789264317.547241:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322813696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264317.547266:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322813824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789264317.547301:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264317.547310:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983784f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.547328:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322813824 00000100:00100000:1.0:1789264317.547332:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322813824 00000100:00100000:1.0:1789264317.547349:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789264317.547355:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17183:x1876179322813824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789264317.547428:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17183:x1876179322813824:12345-0@lo:503:mount.lustre.0 Request processed in 72us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.547435:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789264317.547464:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322813824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789264317.549796:0:17235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17235:1876179322813952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264317.549865:0:17235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264317.549892:0:17235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8811ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.549957:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322813952 00000100:00100000:1.0:1789264317.549969:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322813952 00000100:00100000:1.0:1789264317.550012:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789264317.550020:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17235:x1876179322813952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264317.550127:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17235:x1876179322813952:12345-0@lo:502:llog_process_th.0 Request processed in 107us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.550134:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789264317.550184:0:17235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17235:1876179322813952:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789264317.550240:0:17235:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789264317.550254:0:17235:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c39833e19b8) 00000020:00000080:1.0:1789264317.550272:0:17235:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1789264317.550341:0:17235:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3983f5f000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789264317.550345:0:17235:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c3983f5f000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789264317.550348:0:17235:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3983f5f000 4 00010000:00080000:1.0:1789264317.550375:0:17235:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3aae2fe800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:1.0:1789264317.563471:0:17235:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1789264317.564620:0:17235:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789264317.564663:0:17235:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789264317.564677:0:17235:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xecaf9f2f14ed7db3 00000100:00080000:1.0:1789264317.564688:0:17235:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789264317.564695:0:17235:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c3aae2fe800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264317.564730:0:17235:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f53800 x1876179322814080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789264317.564772:0:17235:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789264317.565796:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876179322814080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789264317.565868:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264317.566009:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322814080 00000100:00100000:1.0:1789264317.566017:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322814080 00000100:00100000:1.0:1789264317.566047:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789264317.566054:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1876179322814080:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789264317.566122:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1876179322814080:12345-0@lo:38:llog_process_th.0 Request processed in 68us (254us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789264317.566128:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789264317.570988:0:17235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17235:1876179322814208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264317.571064:0:17235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264317.571102:0:17235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983784840 going to sleep for 11 seconds 00000100:00100000:3.0:1789264317.571183:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322814208 00000100:00100000:3.0:1789264317.571191:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322814208 00000100:00100000:3.0:1789264317.571242:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789264317.571251:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17235:x1876179322814208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789264317.571359:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17235:x1876179322814208:12345-0@lo:502:llog_process_th.0 Request processed in 108us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264317.571366:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789264317.571614:0:17235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17235:1876179322814208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264317.571654:0:17235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17235:1876179322814336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789264317.571682:0:17235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264317.571709:0:17235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983784840 going to sleep for 11 seconds 00000100:00100000:0.0:1789264317.571776:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322814336 00000100:00100000:0.0:1789264317.571780:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322814336 00000100:00100000:0.0:1789264317.571804:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789264317.571811:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17235:x1876179322814336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789264317.571882:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17235:x1876179322814336:12345-0@lo:502:llog_process_th.0 Request processed in 70us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264317.571889:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789264317.571972:0:17235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17235:1876179322814336:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789264317.571991:0:17235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789264317.572107:0:17183:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789264317.572133:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789264317.572180:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3983e45600/0xecaf9f2f14ed7d9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7da5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.572190:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3983e45600/0xecaf9f2f14ed7d9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7da5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789264317.572233:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789264317.572235:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789264317.572236:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264317.572237:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789264317.572238:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264317.572239:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264317.572241:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789264317.572242:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789264317.572244:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264317.572245:0:17183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789264317.572248:0:17183:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789264317.572250:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789264317.572251:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789264317.572252:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264317.572253:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789264317.572254:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264317.572255:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264317.572256:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789264317.572257:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789264317.572258:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264317.572259:0:17183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789264317.572272:0:17183:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789264317.572281:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322814464:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789264317.572311:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264317.572330:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8922c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789264317.573432:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789264317.573442:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aae2fe800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789264317.573448:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789264317.573451:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876179322814080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789264317.575168:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322814464 00000100:00100000:2.0:1789264317.575180:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322814464 00000100:00100000:2.0:1789264317.575230:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789264317.575240:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17183:x1876179322814464:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789264317.575274:0:17196:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789264317.575288:0:17196:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789264317.581706:0:17196:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789264317.581724:0:17196:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789264317.582104:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17183:x1876179322814464:12345-0@lo:253:mount.lustre.0 Request processed in 6860us (9787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.582115:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789264317.582220:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17183:1876179322814464:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789264317.582234:0:17183:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789264317.582237:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789264317.582238:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789264317.582240:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789264317.582241:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789264317.582242:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789264317.582243:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789264317.582245:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789264317.582246:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789264317.582248:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789264317.582249:0:17183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789264317.582263:0:17183:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789264317.583625:0:17219:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789264317.583633:0:17219:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789264317.583657:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.583687:0:17219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7d82 expref: 11 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.583695:0:17219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.583735:0:17219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed7d82 expref: 11 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.583770:0:17219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7d89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7d82 expref: 11 pid: 17196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264317.583784:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17219:1876179322814592:0@lo:104: 00000100:00100000:0.0:1789264317.583836:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264317.583880:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8f254c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264317.584606:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322814592 00000100:00100000:1.0:1789264317.584615:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322814592 00000100:00100000:1.0:1789264317.584667:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789264317.584677:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+3:17219:x1876179322814592:12345-0@lo:104: 00010000:00010000:1.0:1789264317.584690:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7d89 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.584774:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789264317.584780:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+3:17219:x1876179322814592:12345-0@lo:104: Request processed in 105us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264317.584799:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789264317.584843:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17219:1876179322814592:0@lo:104: 00010000:00010000:1.0:1789264317.584863:0:17219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.585810:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264317.585820:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7d89 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.585829:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264317.585833:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed7d89 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.585841:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed7d89 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264317.585848:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed7d89 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264317.585866:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789264317.585917:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7d89 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.585925:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264317.585948:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7d89 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.585956:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7d82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7d89 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.585976:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264317.585978:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264317.585979:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264317.586011:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3622:1876179322814720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264317.586056:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264317.586145:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322814720 00000100:00100000:0.0:1789264317.586151:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322814720 00010000:00010000:0.0:1789264317.586173:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7d89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7d82 expref: 12 pid: 17196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264317.586196:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789264317.586204:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:3622:x1876179322814720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264317.586213:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264317.586219:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7d89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7d82 expref: 12 pid: 17196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.586228:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7d82 expref: 12 pid: 17196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.586249:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7d89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed7d82 expref: 12 pid: 17196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.586263:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.586270:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789264317.586286:0:17189:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002651830s 00010000:00010000:0.0:1789264317.586290:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.586297:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.586304:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.586310:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.586315:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cb400 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:0.0:1789264317.586318:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.586325:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.586337:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264317.586353:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264317.586384:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+11:3622:x1876179322814720:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264317.586391:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789264317.586427:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3622:1876179322814720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789264317.586549:0:17219:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.586557:0:17219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264317.586563:0:17219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c39836cb400/0xecaf9f2f14ed7dba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789264317.606994:0:17183:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789264317.607306:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789264317.607357:0:17243:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789264317.607361:0:17243:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789264317.607574:0:17244:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1789264317.607929:0:17244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789264317.608614:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1789264317.609004:0:17245:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9c3983f52300 x1876179322814848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264317.609016:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00000040:01000000:2.0:1789264317.609341:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789264317.609378:0:17183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789264317.610166:0:17183:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789264317.610176:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789264317.610218:0:17183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789264317.612232:0:17183:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789264317.612388:0:17244:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789264317.612444:0:17244:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1789264317.613033:0:17183:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789264317.613075:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789264317.613845:0:17183:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1789264317.614310:0:17183:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1789264317.616165:0:17183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789264317.618865:0:17183:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789264317.618912:0:17183:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb65101c8b988 00100000:10000000:0.0:1789264317.618921:0:17183:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789264317.619551:0:17183:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789264317.619580:0:17183:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789264317.619599:0:17183:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1789264317.619622:0:17183:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789264317.620402:0:17183:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789264317.620584:0:17183:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789264318.352842:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789264318.606148:0:17239:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789264318.606157:0:17239:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789264318.607074:0:17239:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1789264318.607083:0:17239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789264318.666261:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 10000000:01000000:0.0:1789264319.309717:0:17201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789264319.309804:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c3983f5f000 from 7 10000000:01000000:0.0:1789264319.309809:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789264319.309854:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264319.309866:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264319.309877:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264319.309975:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322814976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789264319.310041:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264319.310177:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8f254000 going to sleep for 11 seconds 00000100:00100000:3.0:1789264319.314812:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322814976 00000100:00100000:3.0:1789264319.314825:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322814976 00000100:00100000:3.0:1789264319.315025:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789264319.315037:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+11:17201:x1876179322814976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264319.315054:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264319.315077:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed7dc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7dc1 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264319.315102:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed7dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7dc1 expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264319.315125:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed7dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7dc1 expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264319.315134:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b000, rc 0) 00000100:00100000:3.0:1789264319.315219:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17201:x1876179322814976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264319.315226:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789264319.315329:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322814976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789264319.315346:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7dc8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264319.315356:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7dc8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264319.315420:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983621f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322815104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789264319.315457:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264319.321540:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322815104 00000100:00100000:0.0:1789264319.321555:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322815104 00000100:00100000:0.0:1789264319.321631:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789264319.321641:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17201:x1876179322815104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789264319.321666:0:17198:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789264319.321683:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789264319.321686:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789264319.321775:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab26223c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264319.321829:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17201:x1876179322815104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 189us (6371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264319.321838:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789264319.322236:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322815104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789264319.322282:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789264319.322343:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7dc8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264319.322359:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7dc8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264319.370302:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789264319.626882:0:17239:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789264319.626901:0:17239:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789264319.627018:0:17239:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789264319.627052:0:17239:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789264319.627170:0:17239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:3.0:1789264319.692597:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789264320.394100:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264320.714838:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00000001:02000400:2.0:1789264321.065607:0:17488:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789264321.418446:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264321.738920:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00000020:00000004:2.0:1789264321.777914:0:17540:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789264321.778401:0:17540:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789264322.442219:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789264322.471311:0:17590:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789264322.471491:0:17590:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1789264322.570545:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789264322.570559:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789264322.570563:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c39835f1800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789264322.570571:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 397 00000100:00080000:1.0:1789264322.570577:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789264322.570585:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c39835f1800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264322.570608:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f51500 x1876179322815360/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789264322.570626:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264322.570630:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789264322.570632:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264322.570635:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789264322.570637:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789264322.570640:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789264322.570641:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c3aae2fe800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789264322.570645:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c3aae2fe800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264322.570657:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f53800 x1876179322815488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789264322.570697:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789264322.570712:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3622:1876179322815232:0@lo:400:kworker.0 00000100:00100000:1.0:1789264322.570805:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264322.570859:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322815360:0@lo:38:kworker.0 00000100:00100000:1.0:1789264322.570902:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264322.570927:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876179322815488:0@lo:38:kworker.0 00000100:00100000:1.0:1789264322.570964:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264322.571008:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322815360 00000100:00100000:1.0:1789264322.571015:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322815360 00000100:00100000:1.0:1789264322.571043:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789264322.571050:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3621:x1876179322815360:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789264322.571067:0:17209:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789264322.572434:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322815232 00000100:00100000:3.0:1789264322.572444:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322815232 00000100:00100000:3.0:1789264322.572496:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789264322.572505:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:3622:x1876179322815232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264322.572573:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:3622:x1876179322815232:12345-0@lo:400:kworker.0 Request processed in 69us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264322.572579:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789264322.572632:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3622:1876179322815232:0@lo:400:kworker.0 00000100:00100000:0.0:1789264322.576206:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322815488 00000100:00100000:0.0:1789264322.576222:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322815488 00000100:00100000:0.0:1789264322.576276:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789264322.576284:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1876179322815488:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789264322.576415:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:0.0:1789264322.576459:0:17205:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xecaf9f2f14ed7dcf 00000004:00100000:0.0:1789264322.576928:0:17205:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789264322.577077:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9c3ab5600000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789264322.577170:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876179322815488:12345-0@lo:38:kworker.0 Request processed in 885us (6205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264322.577178:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789264322.577488:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c3983f53800 x1876179322815488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789264332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789264322.577506:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789264322.577515:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789264322.577520:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789264322.577522:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aae2fe800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789264322.577528:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876179322815488:0@lo:38:kworker.0 00000100:00100000:1.0:1789264322.592002:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3621:x1876179322815360:12345-0@lo:38:kworker.0 Request processed in 20944us (21092us total) trans 0 rc -19/-19 00000100:00080000:3.0:1789264322.592076:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c39835f1800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789264322.592085:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789264322.592091:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322815360:0@lo:38:kworker.0 00000100:00100000:1.0:1789264322.592400:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789264322.762004:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789264323.466716:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264323.786945:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789264324.492261:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264324.809915:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789264325.513857:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264325.838088:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789264326.539195:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264326.861988:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789264327.566438:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264327.690171:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3624:1876179322815616:0@lo:400:kworker.0 00000100:00100000:2.0:1789264327.690254:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789264327.690323:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789264327.690328:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789264327.690332:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c39835f1800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789264327.690337:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 402 00000100:00080000:0.0:1789264327.690351:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789264327.690357:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c39835f1800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264327.690383:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c39847a4000 x1876179322815744/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789264327.690407:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789264327.690411:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789264327.690413:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789264327.690416:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789264327.690463:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789264317/real 1789264317] req@ffff9c3983f51c00 x1876179322812416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264327 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264327.690483:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c3983f51c00 x1876179322812416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264327 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264327.690493:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789264317/real 1789264317] req@ffff9c3983f50700 x1876179322812288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264327 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264327.690504:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c3983f50700 x1876179322812288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264327 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264327.690519:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322815744:0@lo:38:kworker.0 00000100:00100000:3.0:1789264327.690551:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789264327.690572:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aba916800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789264327.690584:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789264327.690587:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322812416:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789264327.690592:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa1e5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789264327.690597:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789264327.690600:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322812288:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1789264327.691090:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789264327.691109:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322815872:0@lo:400:kworker.0 00000100:00100000:2.0:1789264327.691144:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264327.692326:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322815872 00000100:00100000:3.0:1789264327.692338:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322815872 00000100:00100000:3.0:1789264327.692388:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789264327.692397:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322815872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264327.692469:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322815872:12345-0@lo:400:kworker.0 Request processed in 72us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264327.692476:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789264327.692518:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c39847a6680 x1876179322815872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264327.692531:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322815872:0@lo:400:kworker.0 00000100:00080000:0.0:1789264327.693424:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789264327.693430:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789264327.693434:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa1e5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789264327.693439:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 397 00000100:00080000:0.0:1789264327.693444:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789264327.693450:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c3aaa1e5800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264327.693482:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c39847a5f80 x1876179322816000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789264327.693502:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789264327.693506:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789264327.693508:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c3aba916800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789264327.693511:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 397 00000100:00080000:0.0:1789264327.693514:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789264327.693518:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c3aba916800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264327.693531:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c39847a4e00 x1876179322816128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789264327.693573:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322815616 00000100:00100000:0.0:1789264327.693579:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322815616 00000100:00100000:0.0:1789264327.693618:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789264327.693627:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:3624:x1876179322815616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264327.693646:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322815744 00000100:00100000:1.0:1789264327.693652:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322815744 00000100:00100000:1.0:1789264327.693682:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789264327.693689:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1876179322815744:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1789264327.693693:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:3624:x1876179322815616:12345-0@lo:400:kworker.0 Request processed in 65us (3436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264327.693702:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00020000:1.0:1789264327.693708:0:17208:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789264327.693788:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322816000:0@lo:8:kworker.0 00000400:00000100:3.0:1789264327.693820:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876179322816000 offset 0 length 520: 4 00000100:00100000:3.0:1789264327.693856:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322816128:0@lo:8:kworker.0 00000400:00000100:3.0:1789264327.693879:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876179322816128 offset 0 length 520: 4 00000100:00100000:0.0:1789264327.694963:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3624:1876179322815616:0@lo:400:kworker.0 00000100:00100000:1.0:1789264327.709934:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1876179322815744:12345-0@lo:38:kworker.0 Request processed in 16236us (19373us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789264327.709948:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789264327.709962:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c39835f1800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789264327.709970:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789264327.709975:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322815744:0@lo:38:kworker.0 00000020:01000004:0.0:1789264327.724426:0:17935:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789264327.724434:0:17935:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789264327.724436:0:17935:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789264327.724548:0:17935:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c39835f3800 00000020:01000004:0.0:1789264327.724564:0:17935:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789264327.724575:0:17935:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789264327.724588:0:17935:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9c3982363370) 00000020:00000080:0.0:1789264327.724603:0:17935:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789264327.780023:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789264327.780585:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789264327.784371:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789264327.784679:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1789264327.784945:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789264327.785138:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789264327.786884:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789264327.787161:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789264327.787532:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1789264327.787715:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789264327.792486:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789264327.793545:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789264327.793951:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789264327.794255:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789264327.795522:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789264327.796086:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789264327.796959:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789264327.797406:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1789264327.798004:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1789264327.798409:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789264327.798803:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1789264327.799130:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789264327.799422:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1789264327.799732:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1789264327.800203:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789264327.800618:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789264327.801268:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789264327.805614:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789264327.807110:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789264327.807965:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789264327.809037:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789264327.809798:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789264327.810093:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1789264327.810409:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1789264327.810793:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789264327.811061:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789264327.811255:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789264327.811724:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789264327.812132:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789264327.812387:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789264327.812766:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789264327.812971:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789264327.813235:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789264327.813581:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789264327.813869:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789264327.814295:0:17935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00080000:01000000:3.0:1789264327.815229:0:17935:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789264327.816163:0:17935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789264327.816175:0:17935:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789264327.816188:0:17935:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xecaf9f2f14ed7ddd 00000020:01000004:3.0:1789264327.816197:0:17935:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789264327.816220:0:17935:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.144@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789264327.816223:0:17935:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789264327.816229:0:17935:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789264327.816257:0:17935:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789264327.816261:0:17935:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789264327.824805:0:17935:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789264327.824854:0:17935:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.144@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1789264327.824859:0:17935:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789264327.824860:0:17935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789264327.824862:0:17935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789264327.824863:0:17935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789264327.824864:0:17935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789264327.824870:0:17935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789264327.824872:0:17935:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789264327.824874:0:17935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789264327.824875:0:17935:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789264327.824878:0:17935:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1789264327.824880:0:17935:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789264327.824881:0:17935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789264327.824883:0:17935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789264327.824884:0:17935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789264327.824884:0:17935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789264327.824885:0:17935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789264327.824886:0:17935:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789264327.824887:0:17935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789264327.824888:0:17935:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789264327.824921:0:17935:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789264327.824940:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322816256:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789264327.825079:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264327.825251:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322816256 00000100:00100000:2.0:1789264327.825259:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322816256 00000100:00100000:2.0:1789264327.825322:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789264327.825331:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17935:x1876179322816256:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789264327.825368:0:17196:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789264327.825372:0:17196:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1789264327.825379:0:17196:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789264327.825522:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a3900 going to sleep for 11 seconds 00000100:00100000:2.0:1789264327.826563:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17935:x1876179322816256:12345-0@lo:253:mount.lustre.0 Request processed in 1228us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264327.826574:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789264327.826674:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322816256:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789264327.826688:0:17935:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789264327.826690:0:17935:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789264327.826692:0:17935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789264327.826693:0:17935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789264327.826694:0:17935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789264327.826695:0:17935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789264327.826696:0:17935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789264327.826698:0:17935:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789264327.826700:0:17935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789264327.826701:0:17935:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789264327.826718:0:17935:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c39835f3800 from lustre-MDT0001 10000000:01000000:3.0:1789264327.826768:0:17935:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1789264327.826772:0:17935:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789264327.826778:0:17935:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c3aba8e8000 local copy 00010000:00010000:3.0:1789264327.826787:0:17935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cda expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264327.826904:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322816384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789264327.826937:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264327.827023:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322816384 00000100:00100000:0.0:1789264327.827029:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322816384 00000100:00100000:0.0:1789264327.827073:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789264327.827082:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17935:x1876179322816384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789264327.827141:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17935:x1876179322816384:12345-0@lo:501:mount.lustre.0 Request processed in 60us (203us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789264327.827149:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789264327.831594:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264327.831691:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322816384:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789264327.831718:0:17935:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789264327.831894:0:17935:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789264327.831904:0:17935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cda expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264327.831915:0:17935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cda expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264327.831948:0:17935:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c39835f3800 10000000:01000000:0.0:1789264327.831954:0:17935:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789264327.831959:0:17935:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c3aba8e8000 10000000:01000000:0.0:1789264327.831962:0:17935:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789264327.831965:0:17935:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c3aba8e8000 from 1 10000000:01000000:0.0:1789264327.831967:0:17935:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789264327.832003:0:17935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836cb800/0xecaf9f2f14ed7de4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264327.832012:0:17935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c39836cb800/0xecaf9f2f14ed7de4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264327.832023:0:17935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c39836cb800/0xecaf9f2f14ed7de4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264327.832042:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322816512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789264327.832100:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264327.832189:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264327.832240:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322816512 00000100:00100000:2.0:1789264327.832253:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322816512 00000100:00100000:2.0:1789264327.832340:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789264327.832350:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a907c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+12:17935:x1876179322816512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789264327.832363:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264327.832377:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3abac1c800/0xecaf9f2f14ed7deb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7de4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264327.832400:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3abac1c800/0xecaf9f2f14ed7deb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7de4 expref: 13 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264327.832423:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3abac1c800/0xecaf9f2f14ed7deb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7de4 expref: 13 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264327.832439:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c800, rc 0) 00000100:00100000:2.0:1789264327.832488:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a907c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+13:17935:x1876179322816512:12345-0@lo:101:mount.lustre.0 Request processed in 140us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264327.832495:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789264327.832569:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322816512:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789264327.832582:0:17935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c39836cb800/0xecaf9f2f14ed7de4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7deb expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264327.832590:0:17935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c39836cb800/0xecaf9f2f14ed7de4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7deb expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264327.832627:0:17935:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789264327.832645:0:17935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836cb800/0xecaf9f2f14ed7de4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7deb expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264327.832652:0:17935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c39836cb800/0xecaf9f2f14ed7de4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7deb expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264327.832660:0:17935:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c39835f3800 10000000:01000000:1.0:1789264327.832664:0:17935:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789264327.832667:0:17935:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c39835f3800 from 1 10000000:01000000:1.0:1789264327.832669:0:17935:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789264327.832684:0:17935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3983e44400/0xecaf9f2f14ed7df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264327.832692:0:17935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3983e44400/0xecaf9f2f14ed7df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264327.832699:0:17935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3983e44400/0xecaf9f2f14ed7df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264327.832712:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322816640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789264327.832739:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.833183:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8af49000 going to sleep for 11 seconds 00000100:00100000:0.0:1789264327.833222:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322816640 00000100:00100000:0.0:1789264327.833228:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322816640 00000100:00100000:2.0:1789264327.833274:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789264327.833284:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a907c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+13:17935:x1876179322816640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789264327.833291:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264327.833301:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3abac1cc00/0xecaf9f2f14ed7df9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7df2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264327.833317:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3abac1cc00/0xecaf9f2f14ed7df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7df2 expref: 14 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264327.833325:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3abac1cc00/0xecaf9f2f14ed7df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7df2 expref: 14 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264327.833346:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1cc00, rc 0) 00000100:00100000:2.0:1789264327.833386:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a907c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+14:17935:x1876179322816640:12345-0@lo:101:mount.lustre.0 Request processed in 104us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264327.833392:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789264327.833591:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322816640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789264327.833616:0:17935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3983e44400/0xecaf9f2f14ed7df2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7df9 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264327.833625:0:17935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3983e44400/0xecaf9f2f14ed7df2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7df9 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264327.833647:0:17935:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789264327.833663:0:17935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3983e44400/0xecaf9f2f14ed7df2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7df9 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264327.833670:0:17935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3983e44400/0xecaf9f2f14ed7df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7df9 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264327.833677:0:17935:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789264327.833681:0:17935:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789264327.833686:0:17935:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c39835f3800 10000000:01000000:1.0:1789264327.833690:0:17935:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789264327.833693:0:17935:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789264327.833695:0:17935:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789264327.833713:0:17935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3983e44800/0xecaf9f2f14ed7e00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264327.833720:0:17935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3983e44800/0xecaf9f2f14ed7e00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264327.833727:0:17935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3983e44800/0xecaf9f2f14ed7e00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264327.833771:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322816768:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789264327.833819:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.833843:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8af49000 going to sleep for 11 seconds 00000100:00100000:3.0:1789264327.833982:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322816768 00000100:00100000:3.0:1789264327.833987:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322816768 00000100:00100000:3.0:1789264327.834012:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789264327.834019:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+14:17935:x1876179322816768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789264327.834026:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264327.834036:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36b200/0xecaf9f2f14ed7e07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7e00 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264327.834050:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36b200/0xecaf9f2f14ed7e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7e00 expref: 15 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264327.834058:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36b200/0xecaf9f2f14ed7e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7e00 expref: 15 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264327.834065:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b200, rc 0) 00000100:00100000:3.0:1789264327.834095:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+15:17935:x1876179322816768:12345-0@lo:101:mount.lustre.0 Request processed in 76us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264327.834101:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789264327.834175:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322816768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789264327.834187:0:17935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3983e44800/0xecaf9f2f14ed7e00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7e07 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264327.834203:0:17935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3983e44800/0xecaf9f2f14ed7e00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7e07 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789264327.836044:0:17935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1789264327.836674:0:17935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789264327.841232:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789264327.841289:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789264327.841305:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789264327.841319:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789264327.841335:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1789264327.841348:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1789264327.841361:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1789264327.841373:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789264327.841385:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1789264327.841397:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1789264327.843941:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1789264327.844105:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1789264327.844123:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1789264327.844135:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1789264327.844148:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789264327.844162:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1789264327.844176:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789264327.844189:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789264327.844201:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1789264327.844214:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789264327.844226:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789264327.844317:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1789264327.844330:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1789264327.844361:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1789264327.844367:0:17935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1789264327.844470:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322816896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264327.844549:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.844591:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8af49840 going to sleep for 11 seconds 00000100:00100000:0.0:1789264327.844613:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322816896 00000100:00100000:0.0:1789264327.844620:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322816896 00000100:00100000:0.0:1789264327.844664:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789264327.844670:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+15:17935:x1876179322816896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789264327.844841:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+15:17935:x1876179322816896:12345-0@lo:501:mount.lustre.0 Request processed in 161us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264327.844849:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789264327.844872:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322816896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264327.845090:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322817024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789264327.845127:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.845153:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8af49840 going to sleep for 11 seconds 00000100:00100000:2.0:1789264327.845167:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322817024 00000100:00100000:2.0:1789264327.845172:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322817024 00000100:00100000:2.0:1789264327.845202:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789264327.845213:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+15:17935:x1876179322817024:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789264327.846015:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+15:17935:x1876179322817024:12345-0@lo:503:mount.lustre.0 Request processed in 802us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264327.846023:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789264327.846199:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322817024:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789264327.846890:0:17935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789264327.846975:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322817152:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264327.847036:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.847106:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8af49000 going to sleep for 11 seconds 00000100:00100000:3.0:1789264327.847197:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322817152 00000100:00100000:3.0:1789264327.847204:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322817152 00000100:00100000:3.0:1789264327.847282:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789264327.847291:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+15:17935:x1876179322817152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789264327.847903:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+15:17935:x1876179322817152:12345-0@lo:502:mount.lustre.0 Request processed in 611us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264327.847920:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789264327.848051:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322817152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789264327.848201:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789264327.848228:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1789264327.848242:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1789264327.848254:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1789264327.848265:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1789264327.848278:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1789264327.848292:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1789264327.848305:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1789264327.848319:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1789264327.848331:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1789264327.848344:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1789264327.848356:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1789264327.848368:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1789264327.848379:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1789264327.848392:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1789264327.848416:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1789264327.848443:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1789264327.848458:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1789264327.848470:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1789264327.848482:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1789264327.848493:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1789264327.848506:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1789264327.848519:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1789264327.848534:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1789264327.848546:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1789264327.848557:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1789264327.848569:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1789264327.848581:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1789264327.848594:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1789264327.848606:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1789264327.848618:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1789264327.848631:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1789264327.848658:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1789264327.848675:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1789264327.848687:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1789264327.848698:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1789264327.848710:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1789264327.848723:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1789264327.848736:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1789264327.848966:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1789264327.848984:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1789264327.848999:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1789264327.849012:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1789264327.849025:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1789264327.849058:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322817280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264327.849111:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.849148:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8af49000 going to sleep for 11 seconds 00000100:00100000:2.0:1789264327.849330:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322817280 00000100:00100000:2.0:1789264327.849336:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322817280 00000100:00100000:2.0:1789264327.849432:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789264327.849441:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+15:17935:x1876179322817280:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789264327.849545:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+15:17935:x1876179322817280:12345-0@lo:502:mount.lustre.0 Request processed in 104us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264327.849552:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789264327.849623:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322817280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789264327.849665:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1789264327.849673:0:17935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789264327.850475:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789264327.850486:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264327.850488:0:17939:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789264327.850493:0:17939:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789264327.850496:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789264327.850509:0:17939:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9c3ab30299b8) 00000020:00000080:1.0:1789264327.850528:0:17939:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789264327.850533:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789264327.850615:0:17939:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789264327.850623:0:17939:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xecaf9f2f14ed7e15 00000020:00000080:1.0:1789264327.851017:0:17939:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789264327.851022:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264327.851026:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264327.851027:0:17939:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789264327.851030:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789264327.851034:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264327.851035:0:17939:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789264327.851039:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789264327.851046:0:17939:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9c3ab302b370) 00000020:00000080:1.0:1789264327.851057:0:17939:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789264327.851061:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789264327.851063:0:17939:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789264327.851066:0:17939:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789264327.851071:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789264327.851113:0:17939:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c39835f3800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789264327.851124:0:17939:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9c3ab3028000) 00000020:00000080:1.0:1789264327.851132:0:17939:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789264327.851204:0:17939:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789264327.851209:0:17939:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xecaf9f2f14ed7e2a 00000020:00000080:1.0:1789264327.851378:0:17939:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789264327.851385:0:17939:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789264327.851389:0:17939:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xecaf9f2f14ed7e31 00080000:01000000:1.0:1789264327.851395:0:17939:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789264327.851398:0:17939:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xecaf9f2f14ed7e38 00000100:00100000:1.0:1789264327.883570:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789264327.920506:0:17939:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1789264327.921160:0:17939:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1789264327.921480:0:17939:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789264327.922907:0:17939:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789264327.922923:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264327.922930:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264327.922932:0:17939:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789264327.922936:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789264327.922942:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264327.922944:0:17939:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789264327.922948:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789264327.922954:0:17939:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:00000080:1.0:1789264327.922994:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789264327.923010:0:17939:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9c3ab302cd28) 00000020:00000080:1.0:1789264327.923032:0:17939:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789264327.923039:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789264327.923114:0:17939:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789264327.923121:0:17939:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789264327.923129:0:17939:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xecaf9f2f14ed7e46 00010000:00080000:1.0:1789264327.923167:0:17939:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3aae104800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:1.0:1789264327.930577:0:17939:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789264327.932616:0:17939:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789264327.932630:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789264327.932665:0:17939:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789264327.932686:0:17939:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xecaf9f2f14ed7e4d 00000100:00080000:1.0:1789264327.932697:0:17939:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789264327.932702:0:17939:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c3aae104800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264327.932734:0:17939:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f51180 x1876179322817408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789264327.934145:0:17939:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789264327.934241:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264327.934246:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264327.934249:0:17939:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789264327.934252:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789264327.934254:0:17939:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789264327.934256:0:17939:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789264327.934257:0:17939:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789264327.934259:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789264327.934262:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264327.934263:0:17939:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789264327.934265:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789264327.934269:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264327.934271:0:17939:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789264327.934275:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789264327.934316:0:17939:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789264327.934331:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264327.934335:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264327.934336:0:17939:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789264327.934338:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789264327.934339:0:17939:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1789264327.934341:0:17939:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789264327.934342:0:17939:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789264327.934343:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789264327.934346:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264327.934347:0:17939:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789264327.934349:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789264327.934352:0:17939:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789264327.934355:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264327.934356:0:17939:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789264327.934359:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789264327.934363:0:17939:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:1.0:1789264327.934396:0:17939:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789264327.934399:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789264327.934414:0:17939:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c3ab27cb370) 00000020:00000080:1.0:1789264327.934429:0:17939:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789264327.934435:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789264327.934492:0:17939:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789264327.934499:0:17939:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789264327.934506:0:17939:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xecaf9f2f14ed7e5b 00010000:00080000:1.0:1789264327.934545:0:17939:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3a844f8000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:1.0:1789264327.934704:0:17939:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1789264327.935211:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322817408:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789264327.935278:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264327.935385:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322817408 00000100:00100000:2.0:1789264327.935393:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322817408 00000100:00100000:2.0:1789264327.935436:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789264327.935443:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1876179322817408:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789264327.935477:0:17208:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:2.0:1789264327.935521:0:17208:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xecaf9f2f14ed7e62 00000004:00100000:2.0:1789264327.935536:0:17208:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789264327.935546:0:17208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:3.0:1789264327.936321:0:17939:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789264327.936500:0:17939:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789264327.937731:0:17939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789264327.938713:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789264327.938894:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:2.0:1789264327.939582:0:17208:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa7e7800 : changing import state from RECOVER to FULL 00000040:00080000:0.0:1789264327.939813:0:17944:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789264327.939818:0:17944:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1789264327.940137:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3621:x1876179322817408:12345-0@lo:38:llog_process_th.0 Request processed in 4690us (4856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264327.940149:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789264327.940255:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789264327.940265:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789264327.940274:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789264327.940278:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789264327.940281:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aae104800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789264327.940329:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322817408:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1789264327.940734:0:17939:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789264327.940767:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789264327.940805:0:17939:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789264327.940824:0:17939:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xecaf9f2f14ed7e69 00000100:00080000:1.0:1789264327.940840:0:17939:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789264327.940845:0:17939:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c3a844f8000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264327.940865:0:17939:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f53100 x1876179322817664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789264327.940885:0:17939:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789264327.940898:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322817664:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789264327.940938:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876179322817664 offset 0 length 520: 4 00000020:01000000:1.0:1789264327.940945:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789264327.940948:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264327.940950:0:17939:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789264327.940953:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789264327.940956:0:17939:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1789264327.940957:0:17939:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789264327.940959:0:17939:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789264327.940960:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789264327.940962:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264327.940963:0:17939:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789264327.940965:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789264327.940969:0:17939:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789264327.940980:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789264327.940982:0:17939:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789264327.940986:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789264327.940989:0:17939:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:1.0:1789264327.941009:0:17939:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789264327.941012:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789264327.941022:0:17939:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c3ab27c8000) 00000020:00000080:1.0:1789264327.941034:0:17939:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789264327.941039:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789264327.941110:0:17939:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789264327.941122:0:17939:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789264327.941128:0:17939:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xecaf9f2f14ed7e77 00010000:00080000:1.0:1789264327.941154:0:17939:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3a8455f800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.144@tcp at head 00000100:00100000:3.0:1789264327.941157:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322817536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789264327.941189:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264327.941310:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322817536 00000100:00100000:2.0:1789264327.941316:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322817536 00010000:00010000:1.0:1789264327.941337:0:17939:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000100:00100000:2.0:1789264327.941350:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789264327.941359:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1876179322817536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789264327.941385:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446301696 avail 1300062208 00000040:01000000:1.0:1789264327.941398:0:17939:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789264327.941412:0:17939:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1789264327.941444:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1876179322817536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264327.941452:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789264327.941514:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322817536:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789264327.943494:0:17939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789264327.943689:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789264327.943892:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789264327.944341:0:17946:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789264327.944346:0:17946:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789264327.945191:0:17939:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789264327.945203:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789264327.945242:0:17939:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789264327.945263:0:17939:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xecaf9f2f14ed7e7e 00000100:00080000:3.0:1789264327.945272:0:17939:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789264327.945278:0:17939:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c3a8455f800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1789264327.945318:0:17939:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3984659180 x1876179322817792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789264327.945344:0:17939:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789264327.945395:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264327.945400:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264327.945402:0:17939:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789264327.945405:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264327.945408:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264327.945410:0:17939:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789264327.945413:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789264327.945415:0:17939:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789264327.945417:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264327.945419:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264327.945421:0:17939:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789264327.945423:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264327.945438:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264327.945440:0:17939:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789264327.945444:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789264327.945468:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264327.945472:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264327.945473:0:17939:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789264327.945476:0:17939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1789264327.945550:0:17935:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789264327.945586:0:17935:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789264327.945606:0:17935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3983e44800/0xecaf9f2f14ed7e00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7e07 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264327.945617:0:17935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3983e44800/0xecaf9f2f14ed7e00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7e07 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264327.945627:0:17935:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c39835f3800 from 1 10000000:01000000:0.0:1789264327.945630:0:17935:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789264327.945657:0:17935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264327.945665:0:17935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264327.945676:0:17935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264327.945696:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322817920:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789264327.945781:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264327.945823:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8245b180 going to sleep for 11 seconds 00000100:00100000:2.0:1789264327.945855:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322817792:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789264327.945887:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876179322817792 offset 0 length 520: 4 00000100:00100000:3.0:1789264327.945979:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322817920 00000100:00100000:3.0:1789264327.945985:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322817920 00000100:00100000:3.0:1789264327.946032:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789264327.946045:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+15:17935:x1876179322817920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789264327.946056:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264327.946069:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7e8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7e85 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264327.946091:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7e8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7e85 expref: 16 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264327.946111:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7e8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7e85 expref: 16 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264327.946120:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36aa00, rc 0) 00000100:00100000:3.0:1789264327.946208:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+16:17935:x1876179322817920:12345-0@lo:101:mount.lustre.0 Request processed in 163us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264327.946215:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789264327.946359:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322817920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789264327.946374:0:17935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7e8c expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264327.946383:0:17935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7e8c expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264327.947311:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818048:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789264327.947360:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.947438:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab09600 going to sleep for 11 seconds 00000100:00100000:2.0:1789264327.947560:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322818048 00000100:00100000:2.0:1789264327.947566:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322818048 00000100:00100000:2.0:1789264327.947654:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789264327.947663:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+16:17935:x1876179322818048:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789264327.947679:0:17196:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789264327.947695:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789264327.947698:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789264327.947824:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+16:17935:x1876179322818048:12345-0@lo:256:mount.lustre.0 Request processed in 161us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264327.947850:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789264327.948034:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818048:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789264327.948634:0:17935:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789264327.948664:0:17935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7e8c expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264327.948674:0:17935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7e8c expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264327.948682:0:17935:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c39835f3800 from 1 10000000:01000000:1.0:1789264327.948684:0:17935:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789264327.948713:0:17935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264327.948721:0:17935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264327.948731:0:17935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264327.948788:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789264327.948827:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.949181:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab09600 going to sleep for 11 seconds 00000100:00100000:3.0:1789264327.949272:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322818176 00000100:00100000:3.0:1789264327.949278:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322818176 00000100:00100000:3.0:1789264327.949314:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789264327.949322:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+16:17935:x1876179322818176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789264327.949332:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264327.949343:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7e9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7e93 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264327.949367:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7e9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7e93 expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264327.949377:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7e9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7e93 expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264327.949385:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36ac00, rc 0) 00000100:00100000:3.0:1789264327.949438:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17935:x1876179322818176:12345-0@lo:101:mount.lustre.0 Request processed in 117us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264327.949444:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789264327.949571:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789264327.949585:0:17935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7e9a expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264327.949594:0:17935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7e9a expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789264327.949731:0:17935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789264327.949887:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264327.949930:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.949952:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab099c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264327.950000:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322818304 00000100:00100000:3.0:1789264327.950004:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322818304 00000100:00100000:3.0:1789264327.950030:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789264327.950036:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17935:x1876179322818304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789264327.950124:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17935:x1876179322818304:12345-0@lo:501:mount.lustre.0 Request processed in 87us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264327.950131:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789264327.950232:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264327.950257:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789264327.950292:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.950318:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab099c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264327.950366:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322818432 00000100:00100000:3.0:1789264327.950370:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322818432 00000100:00100000:3.0:1789264327.950389:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789264327.950395:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17935:x1876179322818432:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789264327.950497:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17935:x1876179322818432:12345-0@lo:503:mount.lustre.0 Request processed in 100us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264327.950504:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789264327.950579:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818432:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789264327.950948:0:17935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789264327.951006:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264327.951040:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.951059:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab09600 going to sleep for 11 seconds 00000100:00100000:3.0:1789264327.951117:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322818560 00000100:00100000:3.0:1789264327.951122:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322818560 00000100:00100000:3.0:1789264327.951142:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789264327.951148:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17935:x1876179322818560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789264327.951233:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17935:x1876179322818560:12345-0@lo:502:mount.lustre.0 Request processed in 83us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264327.951240:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789264327.951379:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818560:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789264327.951552:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789264327.951576:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1789264327.951590:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1789264327.951602:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1789264327.951613:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1789264327.951625:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1789264327.951638:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1789264327.951661:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1789264327.951675:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789264327.951688:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1789264327.951700:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1789264327.951728:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264327.951795:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.951812:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab09600 going to sleep for 11 seconds 00000100:00100000:3.0:1789264327.951922:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322818688 00000100:00100000:3.0:1789264327.951927:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322818688 00000100:00100000:3.0:1789264327.951950:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789264327.951957:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17935:x1876179322818688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789264327.952033:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17935:x1876179322818688:12345-0@lo:502:mount.lustre.0 Request processed in 76us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264327.952040:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789264327.952342:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789264327.952388:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1789264327.952396:0:17935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789264327.952800:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264327.952810:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264327.952813:0:17948:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789264327.952821:0:17948:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c39835f3800 00000020:00000080:3.0:1789264327.952824:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789264327.952842:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264327.952845:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264327.952846:0:17948:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789264327.952849:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264327.952852:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264327.952853:0:17948:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789264327.952856:0:17948:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c39835f3800 00000020:00000080:3.0:1789264327.952859:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789264327.952912:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264327.952916:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264327.952918:0:17948:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789264327.952921:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264327.952923:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264327.952925:0:17948:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789264327.952928:0:17948:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c39835f3800 00000020:00000080:3.0:1789264327.952930:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789264327.952948:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264327.952951:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264327.952952:0:17948:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789264327.952955:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789264327.952958:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264327.952959:0:17948:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789264327.952962:0:17948:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c39835f3800 00000020:00000080:3.0:1789264327.952964:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789264327.952985:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789264327.952988:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264327.952990:0:17948:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789264327.952993:0:17948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1789264327.956149:0:17935:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789264327.956192:0:17935:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789264327.956226:0:17935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7e9a expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264327.956238:0:17935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7e9a expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264327.956294:0:17935:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789264327.956297:0:17935:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c39835f3800 10000000:01000000:0.0:1789264327.956301:0:17935:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c39835f3800 10000000:01000000:0.0:1789264327.956304:0:17935:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789264327.956310:0:17935:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c39835f3800 from 1 10000000:01000000:0.0:1789264327.956313:0:17935:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789264327.956346:0:17935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836cac00/0xecaf9f2f14ed7ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264327.956354:0:17935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c39836cac00/0xecaf9f2f14ed7ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264327.956364:0:17935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c39836cac00/0xecaf9f2f14ed7ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264327.956385:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789264327.956455:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264327.956490:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a3900 going to sleep for 11 seconds 00000100:00100000:3.0:1789264327.958557:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322818816 00000100:00100000:3.0:1789264327.958577:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322818816 00000100:00100000:3.0:1789264327.958631:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789264327.958639:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17935:x1876179322818816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789264327.958652:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264327.958668:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed7ea8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7ea1 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264327.958693:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed7ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7ea1 expref: 18 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264327.958703:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36a800/0xecaf9f2f14ed7ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7ea1 expref: 18 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264327.958712:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36a800, rc 0) 00000100:00100000:3.0:1789264327.961491:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17935:x1876179322818816:12345-0@lo:101:mount.lustre.0 Request processed in 2841us (5023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264327.961503:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789264327.964368:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789264327.964395:0:17935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c39836cac00/0xecaf9f2f14ed7ea1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7ea8 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264327.964407:0:17935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c39836cac00/0xecaf9f2f14ed7ea1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7ea8 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789264327.966923:0:17935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789264327.967199:0:17935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789264327.967410:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789264327.968550:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1789264327.968575:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1789264327.968589:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1789264327.968602:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1789264327.968614:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1789264327.968627:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1789264327.968640:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1789264327.968653:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1789264327.968668:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1789264327.968681:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1789264327.968694:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1789264327.968707:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1789264327.968720:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1789264327.969537:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1789264327.969567:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1789264327.969579:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1789264327.969591:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1789264327.969602:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1789264327.969613:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1789264327.969624:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1789264327.969637:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1789264327.969649:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1789264327.969663:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1789264327.969676:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1789264327.969689:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1789264327.969703:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1789264327.969716:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1789264327.969740:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1789264327.971500:0:17935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789264327.971606:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789264327.971666:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264327.971713:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322818944 00000100:00100000:0.0:1789264327.971720:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322818944 00000100:00100000:0.0:1789264327.973039:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789264327.973051:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17935:x1876179322818944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789264327.973182:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17935:x1876179322818944:12345-0@lo:501:mount.lustre.0 Request processed in 134us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264327.973190:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789264327.973233:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc900 going to sleep for 11 seconds 00000100:00100000:0.0:1789264327.973252:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322818944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789264327.973291:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322819072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789264327.973326:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264327.973343:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc900 going to sleep for 11 seconds 00000100:00100000:3.0:1789264327.975564:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322819072 00000100:00100000:3.0:1789264327.975577:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322819072 00000100:00100000:3.0:1789264327.975634:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789264327.975644:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17935:x1876179322819072:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789264327.975846:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17935:x1876179322819072:12345-0@lo:503:mount.lustre.0 Request processed in 203us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264327.975854:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789264327.977050:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322819072:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789264327.977652:0:17935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789264327.977730:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322819200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264327.977824:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.977868:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835a3900 going to sleep for 11 seconds 00000100:00100000:3.0:1789264327.978339:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322819200 00000100:00100000:3.0:1789264327.978346:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322819200 00000100:00100000:3.0:1789264327.978384:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789264327.978392:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17935:x1876179322819200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789264327.978580:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17935:x1876179322819200:12345-0@lo:502:mount.lustre.0 Request processed in 188us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264327.978588:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789264327.978844:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322819200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789264327.979029:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789264327.979057:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1789264327.979071:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1789264327.979085:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1789264327.979099:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1789264327.979112:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1789264327.979138:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1789264327.979153:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1789264327.979166:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1789264327.979179:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1789264327.979193:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1789264327.979207:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1789264327.979220:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1789264327.980341:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1789264327.980376:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1789264327.980391:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1789264327.980417:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1789264327.980572:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1789264327.980590:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1789264327.980604:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1789264327.980616:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1789264327.980629:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1789264327.980656:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1789264327.980671:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1789264327.980684:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1789264327.980696:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1789264327.980708:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1789264327.980720:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1789264327.980733:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1789264327.981388:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1789264327.981417:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1789264327.981506:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1789264327.981522:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1789264327.981535:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1789264327.981547:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1789264327.981558:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1789264327.981569:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1789264327.981582:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1789264327.981610:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1789264327.981625:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1789264327.981639:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1789264327.981653:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1789264327.981665:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1789264327.981679:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1789264327.981692:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1789264327.981704:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1789264327.981716:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1789264327.981729:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1789264327.982351:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322819328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264327.982494:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.982537:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab686c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789264327.982567:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322819328 00000100:00100000:1.0:1789264327.982573:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322819328 00000100:00100000:1.0:1789264327.982791:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789264327.982800:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17935:x1876179322819328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264327.982918:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17935:x1876179322819328:12345-0@lo:502:mount.lustre.0 Request processed in 118us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264327.982925:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789264327.985529:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322819328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789264327.986396:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1789264327.986581:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1789264327.986622:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322819456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264327.986687:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264327.987276:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab686c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789264327.987323:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322819456 00000100:00100000:3.0:1789264327.987448:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322819456 00000100:00100000:2.0:1789264327.987862:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789264327.987933:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17935:x1876179322819456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264327.988068:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17935:x1876179322819456:12345-0@lo:502:mount.lustre.0 Request processed in 197us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264327.988076:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789264327.988339:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322819456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789264327.988424:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1789264327.988869:0:17935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789264327.992027:0:17954:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789264327.992044:0:17954:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9c3aaa490000) 00000020:00000080:3.0:1789264327.992066:0:17954:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789264327.992156:0:17954:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c39835f3800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789264327.992160:0:17954:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c39835f3800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789264327.992162:0:17954:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c39835f3800 3 00010000:00080000:3.0:1789264327.992205:0:17954:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3a846e4800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:3.0:1789264327.993859:0:17954:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1789264327.994053:0:17954:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789264327.994092:0:17954:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789264327.994104:0:17954:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xecaf9f2f14ed7eb6 00000100:00080000:3.0:1789264327.994113:0:17954:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789264327.994118:0:17954:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c3a846e4800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1789264327.994150:0:17954:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c398465b100 x1876179322819584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789264327.994187:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876179322819584:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789264327.994250:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264327.994309:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322819584 00000100:00100000:3.0:1789264327.994316:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322819584 00000100:00100000:3.0:1789264327.994344:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789264327.994351:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1876179322819584:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789264327.994372:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:3.0:1789264327.994411:0:17205:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xecaf9f2f14ed7ebd 00000004:00100000:3.0:1789264327.994423:0:17205:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789264327.994443:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9c3a846e6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789264327.994487:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876179322819584:12345-0@lo:38:llog_process_th.0 Request processed in 135us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264327.994494:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789264327.994524:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c398465b100 x1876179322819584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789264337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264327.994534:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789264327.994541:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789264327.994547:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789264327.994550:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789264327.994553:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3a846e4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789264327.994558:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876179322819584:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789264327.995724:0:17954:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1789264327.996413:0:17954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1789264327.997871:0:17935:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789264327.997910:0:17935:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789264327.997928:0:17935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836cac00/0xecaf9f2f14ed7ea1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7ea8 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264327.997939:0:17935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c39836cac00/0xecaf9f2f14ed7ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7ea8 expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789264327.997984:0:17935:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789264327.997987:0:17935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789264327.997988:0:17935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789264327.997989:0:17935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789264327.997990:0:17935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789264327.997992:0:17935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789264327.997993:0:17935:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789264327.997995:0:17935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789264327.997996:0:17935:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789264327.997999:0:17935:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1789264327.998006:0:17935:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789264327.998007:0:17935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789264327.998008:0:17935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789264327.998009:0:17935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789264327.998010:0:17935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789264327.998011:0:17935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789264327.998011:0:17935:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789264327.998012:0:17935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789264327.998013:0:17935:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789264327.998036:0:17935:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789264327.998054:0:17935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322819712:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789264327.998125:0:17935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264327.998164:0:17935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2622c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264327.999083:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322819712 00000100:00100000:1.0:1789264327.999093:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322819712 00000100:00100000:1.0:1789264327.999139:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789264327.999149:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17935:x1876179322819712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789264327.999178:0:17199:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789264327.999190:0:17199:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1789264328.002903:0:17184:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789264328.003001:0:17199:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789264328.003016:0:17199:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1789264328.003205:0:17219:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789264328.003209:0:17219:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789264328.003239:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264328.003256:0:17219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed7dc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7dc1 expref: 18 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264328.003263:0:17219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7e8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7e85 expref: 18 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264328.003269:0:17219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264328.003305:0:17219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7e8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed7e85 expref: 18 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264328.003313:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17935:x1876179322819712:12345-0@lo:253:mount.lustre.0 Request processed in 4164us (5185us total) trans 0 rc 0/0 00010000:00010000:1.0:1789264328.003317:0:17219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7e8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7e85 expref: 18 pid: 17198 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264328.003323:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789264328.003329:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17219:1876179322819840:0@lo:104: 00000100:00100000:1.0:1789264328.003365:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789264328.003411:0:17219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed7dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed7dc1 expref: 17 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264328.003420:0:17219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed7dc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7dc1 expref: 17 pid: 17199 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264328.003428:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17219:1876179322819968:0@lo:104: 00000100:00100000:1.0:1789264328.003448:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264328.003474:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c612180 going to sleep for 11 seconds 00000100:00100000:1.0:1789264328.003491:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322819840 00000100:00100000:1.0:1789264328.003498:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322819840 00000100:00100000:0.0:1789264328.003511:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322819968 00000100:00100000:0.0:1789264328.003514:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322819968 00000100:00100000:1.0:1789264328.003525:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789264328.003577:0:17935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17935:1876179322819712:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789264328.003588:0:17935:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789264328.003592:0:17935:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789264328.003593:0:17935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789264328.003595:0:17935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789264328.003596:0:17935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789264328.003597:0:17935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789264328.003599:0:17935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789264328.003600:0:17935:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789264328.003602:0:17935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789264328.003604:0:17935:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789264328.003618:0:17935:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789264328.003933:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+4:17219:x1876179322819840:12345-0@lo:104: 00010000:00010000:1.0:1789264328.003946:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7e8c expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264328.003991:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789264328.003997:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+4:17219:x1876179322819840:12345-0@lo:104: Request processed in 465us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264328.007377:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789264328.007413:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789264328.007428:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+3:17219:x1876179322819968:12345-0@lo:104: 00010000:00010000:1.0:1789264328.007447:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7dc8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264328.007577:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789264328.007586:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+3:17219:x1876179322819968:12345-0@lo:104: Request processed in 164us (4135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264328.007595:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264328.008032:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17219:1876179322819840:0@lo:104: 00000100:00100000:0.0:1789264328.008043:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17219:1876179322819968:0@lo:104: 00010000:00010000:0.0:1789264328.008081:0:17219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264328.014737:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789264328.014768:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7e8c expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264328.014780:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836caa00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1789264328.014784:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed7e8c expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264328.014793:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed7e8c expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789264328.014800:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed7e8c expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264328.014806:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789264328.014875:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7e8c expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264328.014883:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789264328.014907:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7e8c expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264328.014914:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c39836caa00/0xecaf9f2f14ed7e85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7e8c expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264328.014937:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789264328.014954:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3622:1876179322820096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789264328.015019:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789264328.015063:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264328.015067:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7dc8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264328.015073:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cb000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1789264328.015076:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed7dc8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264328.015082:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed7dc8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789264328.015088:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed7dc8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264328.015092:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789264328.015105:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7dc8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264328.015111:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789264328.015121:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7dc8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264328.015127:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c39836cb000/0xecaf9f2f14ed7dc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7dc8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264328.015140:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264328.015148:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264328.015150:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264328.015226:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322820096 00000100:00100000:0.0:1789264328.015233:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322820096 00010000:00010000:0.0:1789264328.015260:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7e8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7e85 expref: 18 pid: 17198 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264328.015286:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789264328.015295:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984659c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:3622:x1876179322820096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264328.015306:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264328.015311:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7e8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7e85 expref: 18 pid: 17198 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015323:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7e8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7e85 expref: 18 pid: 17198 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015336:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36aa00/0xecaf9f2f14ed7e8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed7e85 expref: 18 pid: 17198 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015348:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264328.015386:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984659c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:3622:x1876179322820096:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264328.015393:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789264328.015418:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3624:1876179322820224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264328.015456:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264328.015502:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322820224 00000100:00100000:0.0:1789264328.015506:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322820224 00010000:00010000:0.0:1789264328.015519:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed7dc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7dc1 expref: 17 pid: 17199 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264328.015546:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264328.015552:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:3624:x1876179322820224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264328.015559:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264328.015563:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed7dc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7dc1 expref: 17 pid: 17199 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015571:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed7dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7dc1 expref: 17 pid: 17199 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015582:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed7dc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed7dc1 expref: 17 pid: 17199 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015592:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015600:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789264328.015614:0:17190:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012405191s 00010000:00010000:0.0:1789264328.015618:0:17190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015626:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015632:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015638:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015651:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44a00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:0.0:1789264328.015655:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015661:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015674:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015683:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264328.015710:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+16:3624:x1876179322820224:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264328.015716:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264328.015761:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3622:1876179322820096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789264328.015771:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264328.015786:0:17219:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015793:0:17219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264328.015798:0:17219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ec4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264328.015828:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3624:1876179322820224:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1789264328.017103:0:17935:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1789264328.017213:0:17959:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789264328.017217:0:17959:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789264328.018797:0:17960:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1789264328.019279:0:17960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789264328.020404:0:17935:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1789264328.023679:0:17960:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789264328.023785:0:17960:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1789264328.024642:0:17961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17961:1876179322820352:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789264328.024714:0:17961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264328.024773:0:17961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a1240 going to sleep for 11 seconds 00000040:01000000:1.0:1789264328.025534:0:17935:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789264328.025575:0:17935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789264328.026008:0:17935:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789264328.026016:0:17935:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789264328.026053:0:17935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789264328.026363:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322820352 00000100:00100000:2.0:1789264328.026372:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322820352 00000100:00100000:2.0:1789264328.026434:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789264328.026458:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17961:x1876179322820352:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789264328.026557:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17961:x1876179322820352:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 100us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264328.026564:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789264328.026878:0:17961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17961:1876179322820352:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1789264328.026910:0:17961:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789264328.026945:0:17961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17961:1876179322820480:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789264328.026981:0:17961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264328.027002:0:17961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a1240 going to sleep for 11 seconds 00000100:00100000:2.0:1789264328.028570:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322820480 00000100:00100000:2.0:1789264328.028581:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322820480 00000100:00100000:2.0:1789264328.028620:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789264328.028629:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17961:x1876179322820480:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789264328.028800:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17961:x1876179322820480:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 171us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264328.028808:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789264328.028892:0:17961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17961:1876179322820480:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789264328.028966:0:17961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17961:1876179322820608:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789264328.029002:0:17961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264328.029030:0:17961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a1900 going to sleep for 11 seconds 00000100:00100000:2.0:1789264328.029531:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322820608 00000100:00100000:2.0:1789264328.029537:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322820608 00000100:00100000:2.0:1789264328.029572:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789264328.029580:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17961:x1876179322820608:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789264328.029633:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17961:x1876179322820608:12345-0@lo:900:lod0001_rec0000.0 Request processed in 54us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264328.029640:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789264328.029863:0:17961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c3984658380 x1876179322820608/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789264344 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264328.029888:0:17961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17961:1876179322820608:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789264328.029941:0:17961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a7100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17961:1876179322820736:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789264328.029976:0:17961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264328.030003:0:17961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc3c0 going to sleep for 11 seconds 00000040:00080000:1.0:1789264328.031072:0:17935:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1789264328.031556:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322820736 00000100:00100000:2.0:1789264328.031564:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322820736 00000100:00100000:2.0:1789264328.031605:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789264328.031614:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17961:x1876179322820736:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789264328.031733:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17961:x1876179322820736:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 120us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264328.031740:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789264328.031809:0:17961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a7100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17961:1876179322820736:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1789264328.031869:0:17961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789264328.032064:0:17935:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789264328.032096:0:17935:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789264328.032215:0:17935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789264328.032845:0:17935:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:3.0:1789264328.034541:0:17961:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000001:00000004:1.0:1789264328.034600:0:17935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000004:00080000:3.0:1789264328.034602:0:17961:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789264328.034605:0:17961:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1789264328.045851:0:17935:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789264328.045888:0:17935:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb65100d4b988 00100000:10000000:1.0:1789264328.045896:0:17935:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789264328.051538:0:17935:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789264328.051574:0:17935:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789264328.051596:0:17935:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789264328.051613:0:17935:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789264328.063115:0:17935:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789264328.063361:0:17935:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789264328.586081:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264328.905918:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00000040:00080000:3.0:1789264329.034347:0:17956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789264329.610575:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789264329.612872:0:17201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789264329.612880:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c39835f3800 from 8 10000000:01000000:3.0:1789264329.612886:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789264329.612928:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264329.612951:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264329.612962:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264329.612987:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322820864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789264329.613056:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264329.613101:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322820864 00000100:00100000:1.0:1789264329.613109:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322820864 00000100:00100000:3.0:1789264329.613113:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264329.613158:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789264329.613169:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+16:17201:x1876179322820864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789264329.613180:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264329.613193:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ed2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7ecb expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264329.613216:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7ecb expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264329.613226:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7ecb expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264329.613234:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44a00, rc 0) 00000100:00100000:1.0:1789264329.613284:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17201:x1876179322820864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264329.613291:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789264329.613509:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322820864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264329.613523:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7ed2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264329.613532:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7ed2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264329.613579:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322820992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789264329.613608:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264329.613625:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264329.613655:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322820992 00000100:00100000:0.0:1789264329.613661:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322820992 00000100:00100000:0.0:1789264329.613739:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789264329.613765:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17201:x1876179322820992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789264329.613780:0:17199:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789264329.613797:0:17199:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789264329.613800:0:17199:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789264329.613906:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17201:x1876179322820992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264329.613915:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789264329.614095:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322820992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789264329.614139:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789264329.614145:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7ed2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264329.614153:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7ed2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264329.614161:0:17201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789264329.614163:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c3983f5f000 from 8 10000000:01000000:1.0:1789264329.614166:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789264329.614184:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264329.614191:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264329.614198:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264329.614211:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322821120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789264329.614237:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264329.618570:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322821120 00000100:00100000:2.0:1789264329.618586:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322821120 00000100:00100000:1.0:1789264329.618611:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398307b180 going to sleep for 11 seconds 00000100:00100000:2.0:1789264329.618649:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789264329.618659:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17201:x1876179322821120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789264329.618673:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264329.618692:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed7ee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7ed9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264329.618718:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed7ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7ed9 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264329.618731:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed7ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7ed9 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264329.618740:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1d000, rc 0) 00000100:00100000:2.0:1789264329.618832:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17201:x1876179322821120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (4585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264329.618839:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789264329.618875:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322821120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789264329.618893:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7ee0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264329.618903:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7ee0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264329.618976:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322821248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789264329.619012:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264329.619041:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398307b180 going to sleep for 11 seconds 00000100:00100000:2.0:1789264329.619389:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322821248 00000100:00100000:2.0:1789264329.619395:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322821248 00000100:00100000:2.0:1789264329.619432:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789264329.619439:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17201:x1876179322821248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789264329.619452:0:17198:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789264329.619468:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789264329.619471:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789264329.619554:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17201:x1876179322821248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264329.619562:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789264329.621851:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322821248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789264329.621918:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789264329.621929:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7ee0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264329.621939:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7ee0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789264329.867324:0:17239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789264329.934288:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00000040:00080000:3.0:1789264330.058490:0:17956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789264330.639628:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264330.954137:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00000001:02000400:3.0:1789264331.525391:0:18203:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789264331.660045:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264331.981186:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00000020:00000004:1.0:1789264332.182389:0:18255:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789264332.183033:0:18255:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789264332.683110:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789264332.843038:0:18306:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789264332.843211:0:18306:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789264333.001856:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 0 seconds 00000100:00100000:2.0:1789264333.322305:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322821376:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789264333.322498:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789264333.322513:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789264333.322517:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c39835f1800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789264333.322522:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 408 00000100:00080000:3.0:1789264333.322528:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789264333.322534:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c39835f1800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1789264333.322557:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c398465a680 x1876179322821632/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789264333.322573:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789264333.322577:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789264333.322579:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789264333.322582:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789264333.322599:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789264333.322602:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789264333.322604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789264333.322619:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789264333.322643:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3622:1876179322821504:0@lo:400:kworker.0 00000100:00100000:3.0:1789264333.322680:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264333.322723:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789264333.322729:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322821760:0@lo:400:kworker.0 00000100:00100000:3.0:1789264333.322923:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264333.322956:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322821760 00000100:00100000:3.0:1789264333.322963:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322821760 00000100:00100000:3.0:1789264333.323006:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789264333.323021:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322821760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264333.323068:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322821760:12345-0@lo:400:kworker.0 Request processed in 49us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264333.323075:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789264333.323110:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c398465b100 x1876179322821760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264333.323122:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322821760:0@lo:400:kworker.0 00000100:00100000:2.0:1789264333.323296:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264333.323336:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322822016:0@lo:400:kworker.0 00000100:00100000:2.0:1789264333.323363:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264333.323380:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789264333.323385:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322821888:0@lo:400:kworker.0 00000100:00100000:2.0:1789264333.323536:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264333.323568:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322821632:0@lo:38:kworker.0 00000100:00100000:2.0:1789264333.323592:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264333.323678:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322821504 00000100:00100000:2.0:1789264333.323683:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322821504 00000100:00100000:2.0:1789264333.323713:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789264333.323721:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:3622:x1876179322821504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264333.323776:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:3622:x1876179322821504:12345-0@lo:400:kworker.0 Request processed in 56us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264333.323783:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789264333.323824:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322822016 00000100:00100000:2.0:1789264333.323827:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322822016 00000100:00100000:2.0:1789264333.323848:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789264333.323853:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322822016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264333.323884:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322822016:12345-0@lo:400:kworker.0 Request processed in 30us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264333.323889:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789264333.323914:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322821376 00000100:00100000:2.0:1789264333.323918:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322821376 00000100:00100000:2.0:1789264333.323932:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322821888 00000100:00100000:2.0:1789264333.323934:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322821888 00000100:00100000:2.0:1789264333.323942:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322821632 00000100:00100000:2.0:1789264333.323944:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322821632 00000100:00100000:2.0:1789264333.323953:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789264333.323958:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1876179322821376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789264333.323982:0:17208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1789264333.324013:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1876179322821376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264333.324018:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789264333.324029:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789264333.324034:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322821888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264333.324055:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322821888:12345-0@lo:400:kworker.0 Request processed in 21us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264333.324060:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789264333.324069:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789264333.324073:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1876179322821632:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789264333.324092:0:17208:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:2.0:1789264333.324120:0:17208:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xecaf9f2f14ed7ee7 00000004:00100000:2.0:1789264333.324135:0:17208:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789264333.324140:0:17208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789264333.324233:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322821888:0@lo:400:kworker.0 00010000:00080000:2.0:1789264333.324246:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c398465ad80 x1876179322822016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264333.324268:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322822016:0@lo:400:kworker.0 00000100:00100000:2.0:1789264333.324286:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322821376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789264333.324322:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3622:1876179322821504:0@lo:400:kworker.0 00000100:00080000:2.0:1789264333.336062:0:17208:0:(import.c:65:import_set_state_nolock()) ffff9c3a88d13000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789264333.336675:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1876179322821632:12345-0@lo:38:kworker.0 Request processed in 12595us (13078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264333.336681:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1789264333.336688:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789264333.336693:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789264333.336703:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789264333.336709:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789264333.336713:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c39835f1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789264333.336988:0:3621:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003e648e8b): req@ffff9c3983f52300 x1876179322814848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264333.337017:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322821632:0@lo:38:kworker.0 00000100:00100000:2.0:1789264333.337184:0:17245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264333.337239:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322822144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789264333.337324:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39837843c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264333.337404:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264333.337604:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322814848 00000100:00100000:2.0:1789264333.337606:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322822144 00000100:00100000:2.0:1789264333.337613:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322822144 00000100:00100000:1.0:1789264333.337613:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322814848 00000100:00100000:1.0:1789264333.337657:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789264333.337668:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17245:x1876179322814848:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789264333.337950:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17245:x1876179322814848:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 284us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264333.337958:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789264333.337975:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789264333.337982:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322822144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789264333.338001:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789264333.338089:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322822144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264333.338096:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789264333.338145:0:17245:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17245:1876179322814848:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1789264333.338183:0:17245:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789264333.338220:0:17245:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983621880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17245:1876179322822272:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789264333.338252:0:17245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264333.338311:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398307bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789264333.338360:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322822144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789264333.338458:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322822272 00000100:00100000:0.0:1789264333.338463:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322822272 00000100:00100000:0.0:1789264333.338589:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789264333.338603:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17245:x1876179322822272:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789264333.338715:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17245:x1876179322822272:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 113us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264333.338722:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789264333.338784:0:17245:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17245:1876179322822272:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789264333.338864:0:17245:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983621880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17245:1876179322822400:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789264333.338888:0:17245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264333.339065:0:17245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398307bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789264333.339103:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322822400 00000100:00100000:1.0:1789264333.339108:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322822400 00000100:00100000:1.0:1789264333.339128:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789264333.339134:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17245:x1876179322822400:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789264333.339190:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17245:x1876179322822400:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 56us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264333.339196:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789264333.339254:0:17245:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17245:1876179322822400:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789264333.339292:0:17245:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789264333.342133:0:17245:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789264333.342240:0:17245:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 16, retries 0 00000004:00080000:2.0:1789264333.342244:0:17245:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000080:1.0:1789264333.502451:0:18354:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbca7d1a0 20000000:00000080:1.0:1789264333.502469:0:18354:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c3a8466a800 uarg=0000000000000000 20000000:01000000:1.0:1789264333.502508:0:18354:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789264333.502514:0:18354:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789264333.502518:0:18354:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789264333.503175:0:18355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1789264333.503333:0:18354:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789264333.509030:0:18354:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789264333.509062:0:18354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264333.509083:0:18354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed7d97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7d90 expref: 17 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264333.509091:0:18354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7e9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7e93 expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264333.509098:0:18354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264333.509143:0:18354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7e9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed7e93 expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264333.509173:0:18354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7e9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7e93 expref: 17 pid: 17198 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264333.509187:0:18354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18354:1876179322822528:0@lo:104: 00000100:00100000:1.0:1789264333.509245:0:18354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789264333.509352:0:18354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed7d97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed7d90 expref: 17 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264333.509360:0:18354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed7d97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7d90 expref: 17 pid: 17196 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264333.509367:0:18354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18354:1876179322822656:0@lo:104: 00000100:00100000:1.0:1789264333.509385:0:18354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264333.509450:0:18354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab267ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264333.509713:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322822528 00000100:00100000:0.0:1789264333.509721:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322822528 00000100:00100000:0.0:1789264333.510088:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322822656 00000100:00100000:0.0:1789264333.510092:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322822656 00000100:00100000:0.0:1789264333.510109:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789264333.510119:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+4:18354:x1876179322822528:12345-0@lo:104: 00010000:00010000:0.0:1789264333.510133:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7e9a expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264333.510189:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789264333.510194:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+4:18354:x1876179322822528:12345-0@lo:104: Request processed in 77us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264333.510200:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789264333.510216:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789264333.510222:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+3:18354:x1876179322822656:12345-0@lo:104: 00010000:00010000:0.0:1789264333.510228:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7d97 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264333.510253:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789264333.510257:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+3:18354:x1876179322822656:12345-0@lo:104: Request processed in 36us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264333.510262:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789264333.510276:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789264333.510281:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7e9a expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264333.510295:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264333.510299:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed7e9a expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264333.510306:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed7e9a expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264333.510312:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed7e9a expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264333.510316:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789264333.510340:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7e9a expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264333.510345:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264333.510361:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7e9a expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264333.510368:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3983e45800/0xecaf9f2f14ed7e93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7e9a expref: -99 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264333.510378:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264333.510382:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7d97 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264333.510387:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45400 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264333.510389:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed7d97 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264333.510404:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed7d97 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264333.510410:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed7d97 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264333.510415:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789264333.510425:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7d97 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264333.510430:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264333.510442:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7d97 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264333.510448:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3983e45400/0xecaf9f2f14ed7d90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7d97 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264333.510458:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264333.510460:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264333.510461:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264333.510467:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264333.510483:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3623:1876179322822784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264333.510510:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264333.510537:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3624:1876179322822912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264333.510555:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264333.510848:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322822784 00000100:00100000:0.0:1789264333.510852:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322822784 00010000:00010000:0.0:1789264333.510869:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7e9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7e93 expref: 18 pid: 17198 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264333.510900:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322822912 00000100:00100000:0.0:1789264333.510903:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322822912 00010000:00010000:0.0:1789264333.510913:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed7d97 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7d90 expref: 19 pid: 17196 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264333.510923:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789264333.510927:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+19:3623:x1876179322822784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264333.510936:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264333.510941:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7e9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7e93 expref: 19 pid: 17198 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264333.510949:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7e9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7e93 expref: 19 pid: 17198 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264333.510963:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264333.511002:0:17189:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789264333.511011:0:17189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789264333.511106:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789264333.511115:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+19:3624:x1876179322822912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789264333.511123:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264333.511128:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed7d97 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7d90 expref: 19 pid: 17196 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264333.511137:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed7d97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7d90 expref: 19 pid: 17196 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264333.511148:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264333.511155:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264333.511166:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264333.511172:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264333.511177:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264333.511183:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264333.511197:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44c00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264333.511201:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264333.511208:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264333.511215:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264333.511223:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789264333.512894:0:18354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3a8a36ac00/0xecaf9f2f14ed7e9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed7e93 expref: 19 pid: 17198 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264333.512908:0:18354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18354:1876179322822528:0@lo:104: 00010000:00010000:1.0:1789264333.512920:0:18354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed7d97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed7d90 expref: 18 pid: 17196 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264333.512927:0:18354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18354:1876179322822656:0@lo:104: 00010000:00010000:1.0:1789264333.512946:0:18354:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264333.512955:0:18354:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264333.512973:0:18354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264333.512978:0:18354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3983e44c00/0xecaf9f2f14ed7eee lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264333.514098:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:3623:x1876179322822784:12345-0@lo:103:ldlm_bl.0 Request processed in 3164us (3582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264333.514110:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789264333.514236:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3623:1876179322822784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789264333.514376:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+16:3624:x1876179322822912:12345-0@lo:103:ldlm_bl.0 Request processed in 3262us (3818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264333.514384:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789264333.514461:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3624:1876179322822912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264333.707000:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264334.733096:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789264335.433869:0:17201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789264335.433877:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c39835f3800 from 13 10000000:01000000:0.0:1789264335.433882:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789264335.433932:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264335.433943:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264335.433976:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264335.434002:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322823040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789264335.434068:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264335.434118:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835ed000 going to sleep for 11 seconds 00000100:00100000:1.0:1789264335.435677:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322823040 00000100:00100000:1.0:1789264335.435691:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322823040 00000100:00100000:1.0:1789264335.435796:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789264335.435807:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+16:17201:x1876179322823040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789264335.435822:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264335.435840:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3983e45a00/0xecaf9f2f14ed7efc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7ef5 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264335.435866:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e45a00/0xecaf9f2f14ed7efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7ef5 expref: 17 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264335.435878:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3983e45a00/0xecaf9f2f14ed7efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7ef5 expref: 17 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264335.435888:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45a00, rc 0) 00000100:00100000:1.0:1789264335.435961:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17201:x1876179322823040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264335.435969:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789264335.436000:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322823040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264335.436019:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7efc expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264335.436029:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7efc expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264335.436101:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322823168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264335.436135:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264335.436182:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835ed000 going to sleep for 11 seconds 00000100:00100000:2.0:1789264335.436191:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322823168 00000100:00100000:2.0:1789264335.436197:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322823168 00000100:00100000:3.0:1789264335.436238:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789264335.436249:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17201:x1876179322823168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264335.436582:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17201:x1876179322823168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 332us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264335.436733:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322823168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264335.436795:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322823296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264335.436845:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264335.436867:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39835ed000 going to sleep for 11 seconds 00000100:00100000:1.0:1789264335.436897:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322823296 00000100:00100000:1.0:1789264335.436903:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322823296 00000100:00100000:3.0:1789264335.437830:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789264335.438578:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789264335.438592:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17201:x1876179322823296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789264335.438723:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17201:x1876179322823296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (1877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264335.438731:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789264335.438818:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322823296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789264335.441488:0:18488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789264335.441771:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789264335.441806:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789264335.441817:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7efc expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264335.441828:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7efc expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264335.441838:0:17201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789264335.441840:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3983f5f000 from 13 10000000:01000000:2.0:1789264335.441843:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789264335.441879:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264335.441899:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264335.441911:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264335.441934:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983621880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322823424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789264335.441997:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264335.442041:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8f254000 going to sleep for 11 seconds 00000100:00100000:0.0:1789264335.442081:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322823424 00000100:00100000:0.0:1789264335.442088:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322823424 00000100:00100000:0.0:1789264335.442146:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789264335.442156:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+17:17201:x1876179322823424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264335.442168:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264335.442179:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c39836ca000/0xecaf9f2f14ed7f0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7f03 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264335.442202:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c39836ca000/0xecaf9f2f14ed7f0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f03 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264335.442212:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c39836ca000/0xecaf9f2f14ed7f0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f03 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264335.442221:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836ca000, rc 0) 00000100:00100000:0.0:1789264335.442268:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17201:x1876179322823424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264335.442275:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789264335.442410:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322823424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789264335.442424:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f0a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264335.442433:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7f0a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264335.442483:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322823552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789264335.442506:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264335.442528:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab267a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789264335.442676:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322823552 00000100:00100000:0.0:1789264335.442680:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322823552 00000100:00100000:0.0:1789264335.442713:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789264335.442719:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17201:x1876179322823552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264335.442884:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17201:x1876179322823552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264335.442891:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789264335.443226:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322823552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789264335.443317:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983620700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322823680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789264335.443352:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264335.443378:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8f254cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264335.443453:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322823680 00000100:00100000:0.0:1789264335.443457:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322823680 00000100:00100000:0.0:1789264335.443491:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789264335.443498:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17201:x1876179322823680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264335.443649:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:17201:x1876179322823680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264335.443662:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789264335.443791:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983620700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322823680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789264335.446845:0:18489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789264335.447586:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789264335.447610:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789264335.447621:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f0a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264335.447634:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f0a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264335.753908:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264336.778159:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264337.419096:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789264327/real 1789264327] req@ffff9c3984659180 x1876179322817792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264337 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264337.419133:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c3984659180 x1876179322817792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264337 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264337.419144:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789264327/real 1789264327] req@ffff9c3983f53100 x1876179322817664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264337 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264337.419156:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c3983f53100 x1876179322817664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264337 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789264337.419177:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3a8455f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789264337.419197:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789264337.419202:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322817792:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789264337.419208:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3a844f8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789264337.419213:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789264337.419215:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322817664:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789264337.419443:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264337.419448:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789264337.419452:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264337.419455:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789264337.419473:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264337.419476:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789264337.419479:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c3a844f8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789264337.419485:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 408 00000100:00080000:1.0:1789264337.419493:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789264337.419503:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c3a844f8000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264337.419540:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f51180 x1876179322824320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789264337.419555:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322824192:0@lo:400:kworker.0 00000100:00080000:1.0:1789264337.419557:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264337.419566:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789264337.419568:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c3a8455f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789264337.419571:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 408 00000100:00080000:1.0:1789264337.419574:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789264337.419578:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c3a8455f800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264337.419593:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f50700 x1876179322824448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789264337.419636:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322823936:0@lo:400:kworker.0 00000100:00100000:3.0:1789264337.419651:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264337.419681:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264337.419699:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789264337.419709:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3624:1876179322823808:0@lo:400:kworker.0 00000100:00100000:1.0:1789264337.419724:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789264337.419734:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322824064:0@lo:400:kworker.0 00000100:00100000:3.0:1789264337.419781:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264337.419812:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322824576:0@lo:400:kworker.0 00000100:00100000:1.0:1789264337.419818:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264337.419857:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264337.419886:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322824320:0@lo:8:kworker.0 00000100:00100000:3.0:1789264337.419913:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322824192 00000400:00000100:1.0:1789264337.419919:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876179322824320 offset 0 length 520: 4 00000100:00100000:3.0:1789264337.419924:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322824192 00000100:00100000:1.0:1789264337.419936:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322824448:0@lo:8:kworker.0 00000400:00000100:1.0:1789264337.419959:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876179322824448 offset 0 length 520: 4 00000100:00100000:3.0:1789264337.419973:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322823936 00000100:00100000:3.0:1789264337.419978:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322823936 00000100:00100000:3.0:1789264337.420002:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789264337.420011:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322824192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264337.420099:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322824192:12345-0@lo:400:kworker.0 Request processed in 87us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264337.420108:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789264337.420128:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789264337.420135:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322823936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264337.420179:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322823936:12345-0@lo:400:kworker.0 Request processed in 44us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264337.420185:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789264337.420195:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322824192:0@lo:400:kworker.0 00000100:00100000:3.0:1789264337.420216:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322823808 00000100:00100000:3.0:1789264337.420222:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322823808 00000100:00100000:0.0:1789264337.420267:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322823936:0@lo:400:kworker.0 00000100:00100000:3.0:1789264337.420480:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789264337.420491:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:3624:x1876179322823808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264337.420541:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:3624:x1876179322823808:12345-0@lo:400:kworker.0 Request processed in 54us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264337.420550:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789264337.420594:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322824064 00000100:00100000:3.0:1789264337.420599:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322824064 00000100:00100000:3.0:1789264337.420636:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322824576 00000100:00100000:3.0:1789264337.420640:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322824576 00000100:00100000:3.0:1789264337.420660:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789264337.420666:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3624:1876179322823808:0@lo:400:kworker.0 00000100:00100000:3.0:1789264337.420669:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322824064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264337.420727:0:17203:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789264337.420738:0:17203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789264337.420935:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789264337.420940:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1876179322824064:12345-0@lo:400:kworker.0 Request processed in 271us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264337.420948:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322824576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264337.420959:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789264337.421008:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876179322824576:12345-0@lo:400:kworker.0 Request processed in 64us (1151us total) trans 0 rc 0/0 00010000:00080000:3.0:1789264337.421017:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c3983f51c00 x1876179322824576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264337.421034:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876179322824576:0@lo:400:kworker.0 00000100:00100000:0.0:1789264337.421047:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789264337.421274:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c3983f52680 x1876179322824064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264337.421300:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876179322824064:0@lo:400:kworker.0 00010000:00010000:0.0:1789264337.802280:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789264338.271322:0:18705:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789264338.271328:0:18705:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789264338.271330:0:18705:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789264338.271542:0:18705:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c3abb9e8800 00000020:01000004:0.0:1789264338.271562:0:18705:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789264338.271579:0:18705:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789264338.271597:0:18705:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c3982364d28) 00000020:00000080:0.0:1789264338.271618:0:18705:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789264338.324563:0:18705:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789264338.327229:0:18705:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789264338.327736:0:18705:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789264338.328162:0:18705:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789264338.328385:0:18705:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789264338.328630:0:18705:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789264338.328851:0:18705:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1789264338.330024:0:18705:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789264338.330481:0:18705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789264338.330497:0:18705:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789264338.330517:0:18705:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xecaf9f2f14ed7f18 00000020:01000004:2.0:1789264338.330527:0:18705:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789264338.330554:0:18705:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.144@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789264338.330558:0:18705:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789264338.330565:0:18705:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789264338.330572:0:18705:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789264338.330585:0:18705:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c3ab6920000) 00000020:00000080:2.0:1789264338.330601:0:18705:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789264338.332632:0:18705:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789264338.333136:0:18705:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789264338.333141:0:18705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789264338.334088:0:18705:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789264338.334097:0:18705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789264338.335303:0:18705:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789264338.335317:0:18705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789264338.337523:0:18705:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789264338.338051:0:18705:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789264338.338057:0:18705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789264338.342889:0:18705:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789264338.342910:0:18705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789264338.364083:0:18705:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789264338.364347:0:18705:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789264338.364354:0:18705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789264338.366345:0:18705:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789264338.366360:0:18705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789264338.372796:0:18705:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789264338.372817:0:18705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789264338.376597:0:18705:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789264338.376822:0:18705:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789264338.376829:0:18705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789264338.377419:0:18705:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789264338.377428:0:18705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789264338.414528:0:18705:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789264338.414826:0:18705:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789264338.414834:0:18705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789264338.416158:0:18705:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789264338.416168:0:18705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789264338.416885:0:18705:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789264338.416916:0:18705:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789264338.416923:0:18705:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000100:00100000:2.0:1789264338.442799:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322824704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789264338.442868:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264338.443340:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322824704 00000100:00100000:3.0:1789264338.443349:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322824704 00000100:00100000:3.0:1789264338.443396:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789264338.443405:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322824704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789264338.443436:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789264338.443486:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322824704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264338.443504:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789264338.444730:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322824704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789264338.444899:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322824832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789264338.444955:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264338.445078:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322824832 00000100:00100000:1.0:1789264338.445085:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322824832 00000100:00100000:1.0:1789264338.445135:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789264338.445144:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322824832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789264338.445177:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1789264338.445240:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322824832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264338.445248:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789264338.445282:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322824832:0@lo:41:osp-pre-0-1.0 00000040:01000000:0.0:1789264338.448005:0:18705:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789264338.448046:0:18705:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.144@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789264338.448050:0:18705:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789264338.448052:0:18705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789264338.448054:0:18705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264338.448055:0:18705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789264338.448056:0:18705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264338.448057:0:18705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264338.448059:0:18705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789264338.448061:0:18705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264338.448063:0:18705:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789264338.448066:0:18705:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789264338.448068:0:18705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789264338.448070:0:18705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789264338.448071:0:18705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264338.448072:0:18705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789264338.448073:0:18705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264338.448074:0:18705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264338.448075:0:18705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789264338.448076:0:18705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264338.448077:0:18705:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789264338.448100:0:18705:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789264338.448120:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322824960:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789264338.448202:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264338.448261:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789264338.448291:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322824960 00000100:00100000:1.0:1789264338.448299:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322824960 00000100:00100000:1.0:1789264338.448358:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789264338.448367:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:18705:x1876179322824960:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789264338.448403:0:17199:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789264338.448407:0:17199:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789264338.448411:0:17199:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789264338.448734:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:18705:x1876179322824960:12345-0@lo:253:mount.lustre.0 Request processed in 366us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264338.448780:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789264338.448958:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322824960:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789264338.448968:0:18705:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789264338.448970:0:18705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789264338.448971:0:18705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789264338.448972:0:18705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264338.448973:0:18705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789264338.448974:0:18705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264338.448976:0:18705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264338.448977:0:18705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789264338.448979:0:18705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264338.448980:0:18705:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789264338.448999:0:18705:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c3abb9e8800 from lustre-OST0000 10000000:01000000:0.0:1789264338.449024:0:18705:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789264338.449027:0:18705:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789264338.449034:0:18705:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c3aba8e8000 local copy 00010000:00010000:0.0:1789264338.449043:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cda expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264338.449138:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789264338.449166:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264338.449221:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc900 going to sleep for 11 seconds 00000100:00100000:2.0:1789264338.449246:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322825088 00000100:00100000:2.0:1789264338.449253:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322825088 00000100:00100000:2.0:1789264338.449316:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789264338.449326:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a9250d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:18705:x1876179322825088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789264338.449398:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a9250d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:18705:x1876179322825088:12345-0@lo:501:mount.lustre.0 Request processed in 75us (231us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789264338.449405:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789264338.449444:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825088:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789264338.449457:0:18705:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789264338.449473:0:18705:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789264338.449478:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cda expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264338.449486:0:18705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cda expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264338.449597:0:18705:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c3abb9e8800 10000000:01000000:0.0:1789264338.449603:0:18705:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789264338.449608:0:18705:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789264338.449611:0:18705:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789264338.449615:0:18705:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789264338.449618:0:18705:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789264338.449640:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836cbe00/0xecaf9f2f14ed7f26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264338.449647:0:18705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c39836cbe00/0xecaf9f2f14ed7f26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264338.449656:0:18705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c39836cbe00/0xecaf9f2f14ed7f26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264338.449668:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789264338.449696:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264338.449898:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc900 going to sleep for 11 seconds 00000100:00100000:1.0:1789264338.449948:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322825216 00000100:00100000:1.0:1789264338.449959:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322825216 00000100:00100000:1.0:1789264338.449994:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789264338.450001:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a9250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+18:18705:x1876179322825216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789264338.450010:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264338.450021:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3983e45000/0xecaf9f2f14ed7f2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7f26 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264338.450041:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e45000/0xecaf9f2f14ed7f2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f26 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264338.450051:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3983e45000/0xecaf9f2f14ed7f2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f26 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264338.450059:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45000, rc 0) 00000100:00100000:1.0:1789264338.450104:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a9250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+19:18705:x1876179322825216:12345-0@lo:101:mount.lustre.0 Request processed in 104us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264338.450110:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789264338.450215:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789264338.450229:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c39836cbe00/0xecaf9f2f14ed7f26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f2d expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.450240:0:18705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c39836cbe00/0xecaf9f2f14ed7f26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7f2d expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1789264338.450276:0:17936:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1789264338.451363:0:18705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789264338.452051:0:18705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789264338.455090:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789264338.455156:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789264338.455297:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789264338.455312:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789264338.455326:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789264338.455339:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789264338.455411:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789264338.455420:0:18705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789264338.455545:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983623480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789264338.456115:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264338.456233:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae36f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789264338.457094:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322825344 00000100:00100000:0.0:1789264338.457104:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322825344 00000100:00100000:0.0:1789264338.457161:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789264338.457171:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+19:18705:x1876179322825344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789264338.457335:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+19:18705:x1876179322825344:12345-0@lo:501:mount.lustre.0 Request processed in 165us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264338.457343:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789264338.457441:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983623480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789264338.457502:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983623480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789264338.457555:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264338.457729:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae36f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789264338.457800:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322825472 00000100:00100000:0.0:1789264338.457804:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322825472 00000100:00100000:0.0:1789264338.457844:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789264338.457851:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+19:18705:x1876179322825472:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789264338.458808:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+19:18705:x1876179322825472:12345-0@lo:503:mount.lustre.0 Request processed in 954us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264338.458817:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789264338.458930:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983623480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825472:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789264338.459336:0:18705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789264338.459405:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983623480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789264338.459521:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264338.459553:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae36f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789264338.459718:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322825600 00000100:00100000:0.0:1789264338.459723:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322825600 00000100:00100000:0.0:1789264338.459787:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789264338.459798:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+19:18705:x1876179322825600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789264338.460451:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+19:18705:x1876179322825600:12345-0@lo:502:mount.lustre.0 Request processed in 654us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264338.460460:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789264338.460679:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983623480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789264338.461066:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789264338.461094:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789264338.461109:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789264338.461123:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789264338.461135:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789264338.461149:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789264338.461286:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789264338.461301:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789264338.461313:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1789264338.461326:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1789264338.461338:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1789264338.461350:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1789264338.461521:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789264338.461656:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264338.461736:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c39825fc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264338.462130:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322825728 00000100:00100000:2.0:1789264338.462137:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322825728 00000100:00100000:2.0:1789264338.462194:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789264338.462204:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+19:18705:x1876179322825728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789264338.462327:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+19:18705:x1876179322825728:12345-0@lo:502:mount.lustre.0 Request processed in 123us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264338.462334:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789264338.462774:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789264338.462846:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789264338.462857:0:18705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1789264338.463721:0:18722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789264338.463729:0:18722:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789264338.463735:0:18722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264338.463737:0:18722:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789264338.463777:0:18722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789264338.463792:0:18722:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c3982360000) 00000020:00000080:0.0:1789264338.463816:0:18722:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789264338.463823:0:18722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789264338.463905:0:18722:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3abb9e8800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789264338.463913:0:18722:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789264338.463921:0:18722:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xecaf9f2f14ed7f3b 00010000:00010000:0.0:1789264338.470222:0:18722:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1789264338.471042:0:18722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1789264338.472863:0:18722:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1789264338.474203:0:18722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789264338.474215:0:18722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264338.474221:0:18722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264338.474223:0:18722:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789264338.474227:0:18722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789264338.474230:0:18722:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1789264338.474232:0:18722:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789264338.474233:0:18722:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789264338.474235:0:18722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789264338.474238:0:18722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264338.474239:0:18722:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789264338.474249:0:18722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264338.474252:0:18722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264338.474254:0:18722:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789264338.474257:0:18722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789264338.474258:0:18722:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789264338.474261:0:18722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264338.474264:0:18722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264338.474265:0:18722:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789264338.474267:0:18722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264338.474269:0:18722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264338.474270:0:18722:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789264338.474273:0:18722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789264338.474298:0:18722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264338.474300:0:18722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264338.474301:0:18722:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789264338.474304:0:18722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789264338.474446:0:18705:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789264338.474471:0:18705:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789264338.474493:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836cbe00/0xecaf9f2f14ed7f26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f2d expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264338.474504:0:18705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c39836cbe00/0xecaf9f2f14ed7f26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f2d expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264338.474512:0:18705:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3abb9e8800 from 1 10000000:01000000:0.0:1789264338.474515:0:18705:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789264338.474549:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264338.474557:0:18705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264338.474722:0:18705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264338.474848:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789264338.474913:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264338.474985:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8922c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789264338.475025:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322825856 00000100:00100000:2.0:1789264338.475032:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322825856 00000100:00100000:2.0:1789264338.475101:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789264338.475110:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+19:18705:x1876179322825856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789264338.475123:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264338.475136:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3abac1c600/0xecaf9f2f14ed7f49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7f42 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.475158:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3abac1c600/0xecaf9f2f14ed7f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f42 expref: 20 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.475168:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3abac1c600/0xecaf9f2f14ed7f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f42 expref: 20 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.475176:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c600, rc 0) 00000100:00100000:2.0:1789264338.475226:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:18705:x1876179322825856:12345-0@lo:101:mount.lustre.0 Request processed in 117us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264338.475240:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789264338.475323:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789264338.475337:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f49 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264338.475345:0:18705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7f49 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789264338.476562:0:18705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789264338.476948:0:18705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789264338.477142:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789264338.477167:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789264338.477200:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789264338.477207:0:18705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789264338.477272:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789264338.477328:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264338.477822:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322825984 00000100:00100000:1.0:1789264338.477829:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322825984 00000100:00100000:1.0:1789264338.477871:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789264338.477880:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:18705:x1876179322825984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264338.478719:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:18705:x1876179322825984:12345-0@lo:501:mount.lustre.0 Request processed in 836us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264338.478730:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789264338.479527:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa1b6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264338.479559:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322825984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789264338.479662:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322826112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789264338.479718:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264338.479769:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa1b6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264338.479836:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322826112 00000100:00100000:1.0:1789264338.479841:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322826112 00000100:00100000:1.0:1789264338.479877:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789264338.479886:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:18705:x1876179322826112:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789264338.479988:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:18705:x1876179322826112:12345-0@lo:503:mount.lustre.0 Request processed in 102us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264338.479994:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789264338.480455:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322826112:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789264338.480972:0:18705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789264338.481620:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322826240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789264338.481679:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264338.482132:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322826240 00000100:00100000:2.0:1789264338.482139:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322826240 00000100:00100000:2.0:1789264338.482194:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789264338.482203:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:18705:x1876179322826240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789264338.482305:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:18705:x1876179322826240:12345-0@lo:502:mount.lustre.0 Request processed in 102us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264338.482312:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789264338.482652:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa1b66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264338.482675:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322826240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789264338.482983:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789264338.483013:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789264338.483025:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789264338.483038:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789264338.483051:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789264338.483079:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789264338.483093:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789264338.483106:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1789264338.483121:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789264338.483133:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1789264338.483145:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1789264338.483176:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322826368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264338.483220:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264338.483251:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789264338.483315:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322826368 00000100:00100000:2.0:1789264338.483321:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322826368 00000100:00100000:2.0:1789264338.483473:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789264338.483482:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:18705:x1876179322826368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789264338.483712:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:18705:x1876179322826368:12345-0@lo:502:mount.lustre.0 Request processed in 231us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264338.483720:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789264338.483880:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322826368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789264338.483917:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1789264338.483924:0:18705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789264338.484638:0:18726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264338.484649:0:18726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264338.484652:0:18726:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789264338.484658:0:18726:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c3abb9e8800 00000020:00000080:2.0:1789264338.484661:0:18726:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789264338.484670:0:18726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264338.484672:0:18726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264338.484673:0:18726:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789264338.484676:0:18726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264338.484678:0:18726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264338.484680:0:18726:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789264338.484683:0:18726:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c3abb9e8800 00000020:00000080:2.0:1789264338.484685:0:18726:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789264338.484864:0:18726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264338.484869:0:18726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264338.484870:0:18726:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789264338.484873:0:18726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264338.484875:0:18726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264338.484877:0:18726:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789264338.484880:0:18726:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c3abb9e8800 00000020:00000080:2.0:1789264338.484882:0:18726:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789264338.485526:0:18726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264338.485532:0:18726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264338.485534:0:18726:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789264338.485537:0:18726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264338.485540:0:18726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264338.485541:0:18726:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789264338.485545:0:18726:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c3abb9e8800 00000020:00000080:2.0:1789264338.485547:0:18726:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789264338.485641:0:18726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264338.485645:0:18726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264338.485646:0:18726:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789264338.485650:0:18726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1789264338.485872:0:18705:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789264338.485901:0:18705:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789264338.485945:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f49 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264338.485957:0:18705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f49 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264338.486012:0:18705:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789264338.486015:0:18705:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c3abb9e8800 10000000:01000000:0.0:1789264338.486018:0:18705:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c3abb9e8800 10000000:01000000:0.0:1789264338.486022:0:18705:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789264338.486027:0:18705:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3abb9e8800 from 1 10000000:01000000:0.0:1789264338.486029:0:18705:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789264338.486064:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836cb400/0xecaf9f2f14ed7f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264338.486073:0:18705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c39836cb400/0xecaf9f2f14ed7f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264338.486084:0:18705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c39836cb400/0xecaf9f2f14ed7f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264338.486118:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322826496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789264338.486177:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264338.486225:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8922c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789264338.486278:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322826496 00000100:00100000:3.0:1789264338.486285:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322826496 00000100:00100000:3.0:1789264338.486348:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789264338.486651:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:18705:x1876179322826496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789264338.486665:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264338.486680:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed7f57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7f50 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264338.486702:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed7f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f50 expref: 21 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264338.486712:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a8a36b000/0xecaf9f2f14ed7f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f50 expref: 21 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264338.486720:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a8a36b000, rc 0) 00000100:00100000:3.0:1789264338.486798:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:18705:x1876179322826496:12345-0@lo:101:mount.lustre.0 Request processed in 442us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264338.486805:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789264338.487118:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322826496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789264338.487134:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c39836cb400/0xecaf9f2f14ed7f50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f57 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264338.487144:0:18705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c39836cb400/0xecaf9f2f14ed7f50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7f57 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789264338.495244:0:18705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789264338.496423:0:18705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789264338.496884:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789264338.496910:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789264338.496924:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789264338.496938:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789264338.496961:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789264338.496976:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789264338.496990:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789264338.497002:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789264338.497014:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789264338.497041:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789264338.497057:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789264338.497069:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789264338.497082:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789264338.497095:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789264338.497108:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789264338.497121:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789264338.497132:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789264338.497142:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789264338.497154:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789264338.497168:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789264338.497180:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789264338.497191:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789264338.497203:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789264338.497216:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789264338.497230:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789264338.497257:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789264338.497272:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789264338.497286:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789264338.497300:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789264338.497313:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789264338.497326:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789264338.497338:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789264338.497351:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789264338.498873:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789264338.498899:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789264338.498913:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789264338.498927:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789264338.498962:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789264338.498967:0:18705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789264338.499064:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322826624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264338.499124:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264338.499171:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264338.499235:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322826624 00000100:00100000:2.0:1789264338.499244:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322826624 00000100:00100000:2.0:1789264338.499543:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789264338.499553:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:18705:x1876179322826624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789264338.499677:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:18705:x1876179322826624:12345-0@lo:501:mount.lustre.0 Request processed in 125us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264338.499685:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789264338.500558:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322826624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264338.500675:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322826752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789264338.500727:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264338.500790:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264338.500874:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322826752 00000100:00100000:0.0:1789264338.500881:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322826752 00000100:00100000:0.0:1789264338.500917:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789264338.500925:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8920b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:18705:x1876179322826752:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789264338.501018:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8920b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:18705:x1876179322826752:12345-0@lo:503:mount.lustre.0 Request processed in 93us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264338.501025:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789264338.501124:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322826752:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789264338.502813:0:18705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789264338.502898:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322826880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264338.502963:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264338.503006:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264338.503087:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322826880 00000100:00100000:2.0:1789264338.503094:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322826880 00000100:00100000:2.0:1789264338.503146:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789264338.503155:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a89209050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:18705:x1876179322826880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789264338.503255:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a89209050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:18705:x1876179322826880:12345-0@lo:502:mount.lustre.0 Request processed in 101us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264338.503263:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789264338.504274:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322826880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789264338.505823:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789264338.505887:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789264338.505905:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789264338.505917:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789264338.505930:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789264338.505943:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789264338.506691:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789264338.506855:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789264338.506870:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789264338.506883:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789264338.506896:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789264338.507425:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789264338.507467:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789264338.507481:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789264338.507500:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789264338.507514:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789264338.507528:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789264338.507554:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789264338.507569:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789264338.508027:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789264338.508049:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789264338.508064:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789264338.508076:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789264338.508089:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789264338.508102:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789264338.508116:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789264338.508129:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789264338.508141:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789264338.508154:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789264338.508169:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789264338.508182:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789264338.508196:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789264338.508210:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789264338.508237:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789264338.508252:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789264338.508265:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789264338.508278:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789264338.508292:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789264338.508305:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789264338.508318:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789264338.508331:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789264338.508342:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789264338.508353:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789264338.509619:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789264338.509640:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789264338.509673:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789264338.509691:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789264338.509708:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789264338.509814:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322827008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264338.509918:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264338.510426:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264338.510570:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322827008 00000100:00100000:0.0:1789264338.510585:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322827008 00000100:00100000:0.0:1789264338.510626:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789264338.510636:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a89208450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:18705:x1876179322827008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789264338.510783:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a89208450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:18705:x1876179322827008:12345-0@lo:502:mount.lustre.0 Request processed in 149us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264338.510790:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789264338.510851:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322827008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789264338.511050:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789264338.511080:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789264338.511111:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322827136:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264338.511150:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264338.511176:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322827136 00000100:00100000:1.0:1789264338.511182:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322827136 00000100:00100000:1.0:1789264338.511216:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789264338.511224:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a89208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:18705:x1876179322827136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264338.511302:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a89208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:18705:x1876179322827136:12345-0@lo:502:mount.lustre.0 Request processed in 79us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264338.511310:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789264338.511351:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264338.511364:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322827136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789264338.511399:0:18705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789264338.511407:0:18705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789264338.512042:0:18732:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789264338.512056:0:18732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c3ab27c99b8) 00000020:00000080:1.0:1789264338.512078:0:18732:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789264338.512155:0:18732:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3abb9e8800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789264338.512160:0:18732:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c3abb9e8800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789264338.512168:0:18732:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3abb9e8800 3 00010000:00080000:1.0:1789264338.512200:0:18732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c39830e8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.144@tcp at head 00010000:00010000:1.0:1789264338.513998:0:18732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789264338.514271:0:18732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789264338.514314:0:18732:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789264338.514337:0:18732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xecaf9f2f14ed7f65 00000100:00080000:1.0:1789264338.514347:0:18732:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789264338.514353:0:18732:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c39830e8000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264338.514386:0:18732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f51880 x1876179322827264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789264338.514418:0:18732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789264338.514444:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264338.514448:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789264338.514451:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264338.514453:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789264338.514477:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264338.514480:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789264338.514483:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264338.514486:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789264338.514515:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322827520:0@lo:400:kworker.0 00000100:00100000:1.0:1789264338.514574:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264338.514606:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789264338.514612:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322827392:0@lo:400:kworker.0 00000100:00100000:1.0:1789264338.514660:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264338.514815:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1876179322827264:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789264338.514852:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264338.514915:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322827520 00000100:00100000:3.0:1789264338.514922:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322827520 00000100:00100000:1.0:1789264338.514942:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322827392 00000100:00100000:1.0:1789264338.514948:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322827392 00000100:00100000:3.0:1789264338.514962:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322827264 00000100:00100000:3.0:1789264338.514967:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322827264 00000100:00100000:1.0:1789264338.514975:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789264338.514984:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322827520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264338.515034:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322827520:12345-0@lo:400:kworker.0 Request processed in 51us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264338.515041:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789264338.515064:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789264338.515078:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322827392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264338.515202:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322827392:12345-0@lo:400:kworker.0 Request processed in 130us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264338.515389:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789264338.515394:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1876179322827264:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789264338.515415:0:17203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:1.0:1789264338.515447:0:17203:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xecaf9f2f14ed7f6c 00000004:00100000:1.0:1789264338.515462:0:17203:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789264338.515492:0:17203:0:(import.c:65:import_set_state_nolock()) ffff9c3984741000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789264338.515532:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876179322827264:12345-0@lo:38:llog_process_th.0 Request processed in 136us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264338.515538:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789264338.515575:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c3983f53b80 x1876179322827392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264338.515588:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322827392:0@lo:400:kworker.0 00010000:00080000:1.0:1789264338.515599:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c3983f50380 x1876179322827520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264338.515606:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322827520:0@lo:400:kworker.0 00000100:00100000:3.0:1789264338.515771:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789264338.515807:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c3983f51880 x1876179322827264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789264348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264338.515816:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789264338.515823:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789264338.515829:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789264338.515833:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789264338.515835:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c39830e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789264338.515840:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1876179322827264:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1789264338.516835:0:18732:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789264338.516850:0:18732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c3ab27ccd28) 00000020:00000080:1.0:1789264338.516870:0:18732:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1789264338.516972:0:18732:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3abb9e8800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789264338.516977:0:18732:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c3abb9e8800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789264338.516979:0:18732:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3abb9e8800 3 00010000:00080000:1.0:1789264338.517005:0:18732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3984743800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.144@tcp at head 00010000:00010000:1.0:1789264338.519332:0:18732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789264338.519599:0:18732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789264338.519652:0:18732:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789264338.519666:0:18732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xecaf9f2f14ed7f7a 00000100:00080000:1.0:1789264338.519676:0:18732:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789264338.519682:0:18732:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c3984743800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264338.519719:0:18732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f50380 x1876179322827648/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789264338.519845:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3621:1876179322827648:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789264338.519860:0:18732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789264338.519887:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264338.519891:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789264338.519894:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264338.519897:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789264338.519901:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264338.519904:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789264338.519907:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264338.519911:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789264338.519921:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264338.520866:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322827648 00000100:00100000:3.0:1789264338.520876:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322827648 00000100:00100000:3.0:1789264338.520917:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789264338.520925:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1876179322827648:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789264338.520952:0:17203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:3.0:1789264338.520985:0:17203:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xecaf9f2f14ed7f81 00000004:00100000:3.0:1789264338.521001:0:17203:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789264338.521030:0:17203:0:(import.c:65:import_set_state_nolock()) ffff9c3983798800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789264338.521164:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876179322827648:12345-0@lo:38:llog_process_th.0 Request processed in 171us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264338.521173:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789264338.521219:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c3983f50380 x1876179322827648/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789264348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264338.521235:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789264338.521243:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789264338.521250:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789264338.521254:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789264338.521256:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3984743800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789264338.521262:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3621:1876179322827648:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789264338.522956:0:18732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789264338.523062:0:18705:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789264338.523105:0:18705:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789264338.523128:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836cb400/0xecaf9f2f14ed7f50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f57 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264338.523140:0:18705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c39836cb400/0xecaf9f2f14ed7f50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f57 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789264338.523185:0:18705:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789264338.523188:0:18705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789264338.523189:0:18705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264338.523190:0:18705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789264338.523192:0:18705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264338.523193:0:18705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264338.523194:0:18705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789264338.523196:0:18705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264338.523197:0:18705:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789264338.523200:0:18705:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789264338.523203:0:18705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789264338.523204:0:18705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789264338.523205:0:18705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264338.523206:0:18705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789264338.523207:0:18705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264338.523208:0:18705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264338.523209:0:18705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789264338.523210:0:18705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264338.523211:0:18705:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789264338.523233:0:18705:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789264338.523252:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322827776:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789264338.523317:0:18705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264338.523370:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322827776 00000100:00100000:0.0:1789264338.523370:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8b8f9780 going to sleep for 11 seconds 00000100:00100000:1.0:1789264338.523380:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322827776 00000100:00100000:1.0:1789264338.523427:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789264338.523437:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a89209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:18705:x1876179322827776:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789264338.523472:0:17199:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789264338.523486:0:17199:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789264338.527262:0:17199:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789264338.527316:0:17199:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789264338.527399:0:17219:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789264338.527405:0:17219:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789264338.527427:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264338.527445:0:17219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7ecb expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264338.527453:0:17219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed7ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7ed9 expref: 21 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264338.527460:0:17219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264338.527500:0:17219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed7ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed7ed9 expref: 21 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264338.527515:0:17219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed7ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ed9 expref: 21 pid: 17196 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264338.527531:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17219:1876179322827904:0@lo:104: 00000100:00100000:1.0:1789264338.527598:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264338.527779:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a89209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:18705:x1876179322827776:12345-0@lo:253:mount.lustre.0 Request processed in 4307us (4425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264338.527792:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789264338.527792:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:18705:1876179322827776:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789264338.527809:0:18705:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789264338.527813:0:18705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789264338.527821:0:18705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789264338.527823:0:18705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264338.527825:0:18705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789264338.527826:0:18705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264338.527827:0:18705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264338.527829:0:18705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789264338.527831:0:18705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264338.527833:0:18705:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789264338.527849:0:18705:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789264338.527941:0:17219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed7ecb expref: 20 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264338.527952:0:17219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ed2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ecb expref: 20 pid: 17198 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264338.527961:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17219:1876179322828032:0@lo:104: 00000100:00100000:1.0:1789264338.527996:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264338.528169:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b7540 going to sleep for 11 seconds 00000100:00100000:2.0:1789264338.528230:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789264338.528248:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322827904 00000100:00100000:2.0:1789264338.528254:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322827904 00000100:00100000:2.0:1789264338.528288:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322828032 00000100:00100000:2.0:1789264338.528292:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322828032 00000100:00100000:2.0:1789264338.528314:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789264338.528323:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+4:17219:x1876179322827904:12345-0@lo:104: 00010000:00010000:2.0:1789264338.528335:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7ee0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.528388:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789264338.528393:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+4:17219:x1876179322827904:12345-0@lo:104: Request processed in 73us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264338.528400:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789264338.528417:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789264338.528425:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a892fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+3:17219:x1876179322828032:12345-0@lo:104: 00010000:00010000:2.0:1789264338.528438:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7ed2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264338.528440:0:17187:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:3.0:1789264338.528450:0:17187:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789264338.528456:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1789264338.528467:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789264338.528612:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17219:1876179322827904:0@lo:104: 00000100:00100000:1.0:1789264338.528620:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17219:1876179322828032:0@lo:104: 00010000:00010000:1.0:1789264338.528693:0:17219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.528722:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789264338.528725:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7ee0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264338.528729:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a892fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+3:17219:x1876179322828032:12345-0@lo:104: Request processed in 306us (732us total) trans 0 rc 0/0 00010000:00010000:3.0:1789264338.528734:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44200 already unused, calling callback (ffffffffc148ec20) 00000100:00100000:2.0:1789264338.528735:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:00010000:3.0:1789264338.528909:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed7ee0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264338.528918:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed7ee0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789264338.528925:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed7ee0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264338.528931:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789264338.528973:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7ee0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264338.528981:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264338.528997:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264338.529002:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7ee0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264338.529163:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789264338.529176:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3623:1876179322828160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789264338.529208:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3983e44200/0xecaf9f2f14ed7ed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7ee0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264338.529210:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789264338.529221:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264338.529223:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264338.529224:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264338.529408:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322828160 00000100:00100000:0.0:1789264338.529413:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322828160 00010000:00010000:0.0:1789264338.529436:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed7ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ed9 expref: 21 pid: 17196 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264338.529467:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789264338.529475:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:3623:x1876179322828160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264338.529487:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264338.529493:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed7ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ed9 expref: 21 pid: 17196 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264338.529506:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed7ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ed9 expref: 21 pid: 17196 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264338.529521:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed7ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ed9 expref: 21 pid: 17196 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264338.529533:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264338.529572:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:3623:x1876179322828160:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264338.529580:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789264338.529587:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3623:1876179322828160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789264338.529697:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264338.529699:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264338.529701:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264338.529733:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7ed2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.529772:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b400 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1789264338.529777:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed7ed2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.529784:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed7ed2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789264338.529792:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed7ed2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264338.529797:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789264338.529823:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7ed2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.529829:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789264338.529845:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7ed2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.529852:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b400/0xecaf9f2f14ed7ecb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7ed2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.529867:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264338.529868:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3623:1876179322828288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789264338.529870:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264338.529874:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264338.529911:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264338.530018:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322828288 00000100:00100000:2.0:1789264338.530023:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322828288 00010000:00010000:2.0:1789264338.530039:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ed2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ecb expref: 20 pid: 17198 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264338.530102:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789264338.530109:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983751450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:3623:x1876179322828288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789264338.530117:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264338.530122:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ed2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ecb expref: 20 pid: 17198 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.530131:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ecb expref: 20 pid: 17198 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.530143:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3983e44a00/0xecaf9f2f14ed7ed2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ecb expref: 20 pid: 17198 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.530155:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.530164:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789264338.530177:0:17189:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012405191s 00010000:00010000:2.0:1789264338.530181:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.530188:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.530196:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.530203:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.530215:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44600 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264338.530219:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.530227:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.530247:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264338.530256:0:17219:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264338.530258:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789264338.530267:0:17219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264338.530274:0:17219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3983e44600/0xecaf9f2f14ed7f88 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264338.530294:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983751450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+19:3623:x1876179322828288:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264338.530301:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789264338.530379:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3623:1876179322828288:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1789264338.531523:0:18705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789264338.535445:0:18705:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789264338.535454:0:18705:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789264338.535489:0:18705:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789264338.535530:0:18705:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789264338.535548:0:18705:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789264338.535564:0:18705:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789264338.536431:0:18705:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789264338.536676:0:18705:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789264338.826253:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789264339.069390:0:18787:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789264339.069606:0:18787:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1789264339.083016:0:17239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789264339.851386:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789264340.300433:0:17956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789264340.425834:0:17201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789264340.425843:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c39835f3800 from 9 10000000:01000000:0.0:1789264340.425849:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789264340.425893:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264340.425905:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264340.425917:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264340.425942:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322828416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789264340.426018:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264340.426069:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa4546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264340.426105:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322828416 00000100:00100000:2.0:1789264340.426113:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322828416 00000100:00100000:2.0:1789264340.426166:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789264340.426175:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+19:17201:x1876179322828416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789264340.426187:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264340.426201:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3abac1d600/0xecaf9f2f14ed7f96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7f8f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264340.426222:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3abac1d600/0xecaf9f2f14ed7f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f8f expref: 20 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264340.426233:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3abac1d600/0xecaf9f2f14ed7f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f8f expref: 20 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264340.426249:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1d600, rc 0) 00000100:00100000:2.0:1789264340.426291:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:17201:x1876179322828416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264340.426298:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789264340.426314:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322828416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264340.426331:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f96 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264340.426353:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7f96 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264340.426402:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322828544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789264340.426434:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264340.426452:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa4546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264340.426556:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322828544 00000100:00100000:3.0:1789264340.426561:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322828544 00000100:00100000:3.0:1789264340.426637:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789264340.426646:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:17201:x1876179322828544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789264340.426661:0:17199:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789264340.426677:0:17199:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789264340.426681:0:17199:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789264340.426813:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:17201:x1876179322828544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 169us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264340.426821:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789264340.426905:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322828544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789264340.426976:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789264340.426983:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f96 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264340.426991:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7f96 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264340.427001:0:17201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789264340.427003:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c3983f5f000 from 9 10000000:01000000:2.0:1789264340.427005:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789264340.427024:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264340.427031:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264340.427038:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264340.427053:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322828672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789264340.427082:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264340.427312:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2622a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789264340.427358:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322828672 00000100:00100000:0.0:1789264340.427363:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322828672 00000100:00100000:0.0:1789264340.427389:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789264340.427395:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:17201:x1876179322828672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264340.427403:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264340.427412:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c39836caa00/0xecaf9f2f14ed7fa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed7f9d expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264340.427428:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c39836caa00/0xecaf9f2f14ed7fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f9d expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264340.427436:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c39836caa00/0xecaf9f2f14ed7fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f9d expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264340.427443:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c39836caa00, rc 0) 00000100:00100000:0.0:1789264340.427476:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:17201:x1876179322828672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264340.427482:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789264340.427591:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322828672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264340.427604:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7fa4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264340.427618:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed7fa4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264340.427662:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322828800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789264340.427697:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264340.427720:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab7f4dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264340.427804:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322828800 00000100:00100000:0.0:1789264340.427808:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322828800 00000100:00100000:0.0:1789264340.427831:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789264340.427845:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:17201:x1876179322828800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789264340.427857:0:17198:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789264340.427870:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789264340.427874:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1789264340.428027:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:17201:x1876179322828800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 182us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264340.428034:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789264340.428122:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322828800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789264340.428167:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789264340.428173:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7fa4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264340.428180:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7fa4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264340.876137:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264341.900288:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789264342.273455:0:19077:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789264342.602482:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789264327/real 1789264327] req@ffff9c39847a5f80 x1876179322816000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264342 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264342.602515:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c39847a5f80 x1876179322816000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264342 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264342.602528:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789264327/real 1789264327] req@ffff9c39847a4e00 x1876179322816128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264342 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264342.602543:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c39847a4e00 x1876179322816128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264342 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789264342.602566:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa1e5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789264342.602633:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789264342.602640:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322816000:0@lo:8:kworker.0 00000100:00080000:0.0:1789264342.602648:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aba916800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789264342.602663:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789264342.602669:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322816128:0@lo:8:kworker.0 00000100:00080000:1.0:1789264342.602700:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264342.602705:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789264342.602709:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa1e5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789264342.602721:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 408 00000100:00080000:1.0:1789264342.602727:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789264342.603064:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c3aaa1e5800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264342.603098:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f53100 x1876179322829184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789264342.603125:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264342.603129:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789264342.603131:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c3aba916800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789264342.603136:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 408 00000100:00080000:1.0:1789264342.603140:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789264342.603144:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c3aba916800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264342.603159:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f52d80 x1876179322829312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789264342.603200:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264342.603204:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789264342.603207:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264342.603210:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789264342.603248:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789264342.603251:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322829568:0@lo:400:kworker.0 00000100:00080000:1.0:1789264342.603253:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789264342.603257:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264342.603263:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789264342.603288:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322829056:0@lo:400:kworker.0 00000100:00100000:0.0:1789264342.603328:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264342.603375:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789264342.603384:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322829440:0@lo:400:kworker.0 00000100:00100000:0.0:1789264342.603419:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264342.603454:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1876179322829952:0@lo:400:kworker.0 00000100:00100000:0.0:1789264342.603485:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264342.603531:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322829568 00000100:00100000:0.0:1789264342.603539:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322829568 00000100:00100000:0.0:1789264342.603592:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789264342.603602:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322829568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264342.603659:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322829568:12345-0@lo:400:kworker.0 Request processed in 59us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264342.603668:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789264342.603699:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264342.603787:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1876179322829824:0@lo:400:kworker.0 00000100:00100000:0.0:1789264342.603822:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264342.603850:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789264342.603859:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3625:1876179322828928:0@lo:400:kworker.0 00000100:00100000:0.0:1789264342.603894:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264342.603939:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322829696:0@lo:400:kworker.0 00000100:00100000:0.0:1789264342.604662:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264342.604905:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322829440 00000100:00100000:0.0:1789264342.604910:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322829440 00000100:00100000:0.0:1789264342.604938:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322829952 00000100:00100000:0.0:1789264342.604940:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322829952 00000100:00100000:0.0:1789264342.604978:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322829824 00000100:00100000:0.0:1789264342.604981:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322829824 00000100:00100000:0.0:1789264342.605018:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322829696 00000100:00100000:0.0:1789264342.605021:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322829696 00000100:00100000:0.0:1789264342.605034:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264342.605041:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322829440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264342.605079:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1876179322829440:12345-0@lo:400:kworker.0 Request processed in 38us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264342.605085:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264342.605098:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264342.605104:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1876179322829952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264342.606078:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789264342.606093:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876179322829824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264342.606156:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876179322829824:12345-0@lo:400:kworker.0 Request processed in 67us (2334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264342.606173:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789264342.606200:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789264342.606220:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322829696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264342.606263:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876179322829696:12345-0@lo:400:kworker.0 Request processed in 55us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264342.606272:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789264342.606287:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1876179322829952:12345-0@lo:400:kworker.0 Request processed in 28us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264342.606297:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264342.606333:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322829056 00000100:00100000:0.0:1789264342.606338:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322829056 00000100:00100000:0.0:1789264342.606363:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789264342.606372:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322829056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264342.606414:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322829056:12345-0@lo:400:kworker.0 Request processed in 44us (2716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264342.606422:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789264342.606449:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322828928 00000100:00100000:0.0:1789264342.606454:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322828928 00000100:00100000:0.0:1789264342.606501:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789264342.606511:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:3625:x1876179322828928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264342.606550:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:3625:x1876179322828928:12345-0@lo:400:kworker.0 Request processed in 41us (2656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264342.606559:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1789264342.606613:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789264342.606624:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789264342.606650:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322829184:0@lo:8:kworker.0 00000100:00100000:0.0:1789264342.606683:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264342.606732:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322829312:0@lo:8:kworker.0 00000100:00100000:0.0:1789264342.606784:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264342.606826:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322829184 00000100:00100000:0.0:1789264342.606830:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322829184 00000100:00100000:0.0:1789264342.606853:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322829312 00000100:00100000:0.0:1789264342.606857:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322829312 00000100:00100000:1.0:1789264342.606862:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789264342.606870:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3621:x1876179322829184:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789264342.606896:0:18709:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 422 last 0 00010000:00080000:0.0:1789264342.606903:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983f51f80 x1876179322829440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264342.606917:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1876179322829440:0@lo:400:kworker.0 00000020:00000080:1.0:1789264342.606926:0:18709:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xecaf9f2f14ed7fab 00010000:00080000:0.0:1789264342.606930:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983f50380 x1876179322829952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264342.606940:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1876179322829952:0@lo:400:kworker.0 00002000:00100000:1.0:1789264342.606942:0:18709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c3984747800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789264342.606949:0:18709:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789264342.606953:0:18709:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789264342.606964:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322829568:0@lo:400:kworker.0 00000100:00100000:0.0:1789264342.606996:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3625:1876179322828928:0@lo:400:kworker.0 00002000:00080000:1.0:1789264342.607139:0:18709:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789264342.607162:0:18709:0:(import.c:65:import_set_state_nolock()) ffff9c3984742800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789264342.607204:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1876179322829184:12345-0@lo:8:kworker.0 Request processed in 334us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264342.607282:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789264342.607299:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789264342.607304:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3621:x1876179322829312:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789264342.607316:0:18709:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1789264342.607928:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983f53100 x1876179322829184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789264362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264342.608474:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00080000:0.0:1789264342.608478:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983f52300 x1876179322829696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789264342.608484:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789264342.608494:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1789264342.608500:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876179322829696:0@lo:400:kworker.0 00000100:00080000:3.0:1789264342.608501:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789264342.608506:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aaa1e5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789264342.608525:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322829056:0@lo:400:kworker.0 00000004:00080000:3.0:1789264342.608530:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789264342.608538:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322829184:0@lo:8:kworker.0 00010000:00080000:0.0:1789264342.608541:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983f50a80 x1876179322829824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264342.608552:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1876179322829824:0@lo:400:kworker.0 00000004:00080000:3.0:1789264342.608605:0:17228:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1789264342.608611:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322830080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789264342.608635:0:17228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984659c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17228:1876179322830208:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789264342.608657:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264342.608852:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322830080 00000100:00100000:3.0:1789264342.608858:0:17228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264342.608859:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322830080 00000100:00100000:3.0:1789264342.608879:0:17228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a893d4780 going to sleep for 11 seconds 00000100:00100000:3.0:1789264342.608903:0:18710:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789264342.608910:0:18710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789264342.608916:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789264342.608927:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1876179322830080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789264342.608948:0:18712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789264342.609502:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1876179322830080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 576us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264342.609509:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1789264342.609536:0:17227:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789264342.609614:0:17227:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 422950869312ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789264342.609620:0:17227:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:0.0:1789264342.609642:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789264342.609664:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3984658380 x1876179322830080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264342.609681:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322830080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789264342.612396:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322830208 00000100:00100000:2.0:1789264342.612408:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322830208 00000100:00100000:0.0:1789264342.613171:0:19101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264342.613182:0:19101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17228:x1876179322830208:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789264342.616545:0:19101:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789264342.616557:0:19101:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789264342.616564:0:19101:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000004:00080000:2.0:1789264342.621234:0:17184:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789264342.623000:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3621:x1876179322829312:12345-0@lo:8:kworker.0 Request processed in 15689us (16209us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789264342.623013:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789264342.623290:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aba916800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789264342.623297:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789264342.623300:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322829312:0@lo:8:kworker.0 00002000:00010000:1.0:1789264342.636377:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.636393:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed7fb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.636411:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.636416:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.636422:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed7fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.636439:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed7fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.636449:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed7fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.636458:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed7fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.636879:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264342.637493:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264342.637500:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed7fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.637795:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44a00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264342.637800:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed7fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.637810:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed7fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.637832:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed7fb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789264342.638061:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.638066:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde2c7b8/0xecaf9f2f14ed7fb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.638075:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.638078:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.638085:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde2c7b8/0xecaf9f2f14ed7fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.638108:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fde2c7b8/0xecaf9f2f14ed7fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.638116:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde2c7b8/0xecaf9f2f14ed7fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.638124:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fde2c7b8/0xecaf9f2f14ed7fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.638147:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264342.638329:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4883349/0xecaf9f2f14ed7fb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.638348:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264342.638353:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fde2c7b8/0xecaf9f2f14ed7fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.638370:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44200 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264342.638374:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde2c7b8/0xecaf9f2f14ed7fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.638376:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.638385:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde2c7b8/0xecaf9f2f14ed7fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.638396:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fde2c7b8/0xecaf9f2f14ed7fb9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.638404:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fde2c7b8/0xecaf9f2f14ed7fb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.638416:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.638418:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.638420:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789264342.638534:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.638541:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029bfcc59/0xecaf9f2f14ed7fc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.638549:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.638552:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.638556:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029bfcc59/0xecaf9f2f14ed7fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.638565:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029bfcc59/0xecaf9f2f14ed7fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.638573:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029bfcc59/0xecaf9f2f14ed7fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.638591:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029bfcc59/0xecaf9f2f14ed7fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.638615:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789264342.638770:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264342.638777:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029bfcc59/0xecaf9f2f14ed7fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.638796:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44600 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:0.0:1789264342.638800:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029bfcc59/0xecaf9f2f14ed7fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.638812:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029bfcc59/0xecaf9f2f14ed7fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.638825:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029bfcc59/0xecaf9f2f14ed7fc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.638833:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029bfcc59/0xecaf9f2f14ed7fc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.638846:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264342.638847:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264342.638849:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789264342.639034:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.639040:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d22482fd/0xecaf9f2f14ed7fc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639049:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.639052:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.639056:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d22482fd/0xecaf9f2f14ed7fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639066:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d22482fd/0xecaf9f2f14ed7fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639073:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d22482fd/0xecaf9f2f14ed7fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639081:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d22482fd/0xecaf9f2f14ed7fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639095:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264342.639336:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264342.639342:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d22482fd/0xecaf9f2f14ed7fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.639351:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45200 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264342.639353:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d22482fd/0xecaf9f2f14ed7fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.639360:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d22482fd/0xecaf9f2f14ed7fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.639379:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d22482fd/0xecaf9f2f14ed7fc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.639388:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d22482fd/0xecaf9f2f14ed7fc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.639410:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.639412:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.639414:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789264342.639421:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.639428:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec48d4b2/0xecaf9f2f14ed7fce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639443:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.639445:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.639449:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec48d4b2/0xecaf9f2f14ed7fce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639457:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec48d4b2/0xecaf9f2f14ed7fce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639464:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec48d4b2/0xecaf9f2f14ed7fce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639471:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec48d4b2/0xecaf9f2f14ed7fce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639493:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264342.639612:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264342.639617:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec48d4b2/0xecaf9f2f14ed7fce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.639626:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44c00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264342.639630:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec48d4b2/0xecaf9f2f14ed7fce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.639639:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec48d4b2/0xecaf9f2f14ed7fce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.639652:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec48d4b2/0xecaf9f2f14ed7fce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.639660:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec48d4b2/0xecaf9f2f14ed7fce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.639687:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.639689:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.639691:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789264342.639914:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.639921:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ed66208/0xecaf9f2f14ed7fd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639929:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.639933:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.639937:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ed66208/0xecaf9f2f14ed7fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639946:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ed66208/0xecaf9f2f14ed7fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639964:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ed66208/0xecaf9f2f14ed7fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639972:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ed66208/0xecaf9f2f14ed7fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.639989:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789264342.640185:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264342.640192:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ed66208/0xecaf9f2f14ed7fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.640199:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45400 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:0.0:1789264342.640202:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ed66208/0xecaf9f2f14ed7fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.640211:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ed66208/0xecaf9f2f14ed7fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.640233:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ed66208/0xecaf9f2f14ed7fd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.640240:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ed66208/0xecaf9f2f14ed7fd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.640260:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264342.640262:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264342.640263:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789264342.640473:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.640480:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052ed9dcc/0xecaf9f2f14ed7fdc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.640488:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.640492:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.640496:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052ed9dcc/0xecaf9f2f14ed7fdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.640506:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052ed9dcc/0xecaf9f2f14ed7fdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.640513:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052ed9dcc/0xecaf9f2f14ed7fdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.640520:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052ed9dcc/0xecaf9f2f14ed7fdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.640551:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264342.640767:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264342.640773:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052ed9dcc/0xecaf9f2f14ed7fdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.640780:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45800 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264342.640784:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052ed9dcc/0xecaf9f2f14ed7fdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.640793:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052ed9dcc/0xecaf9f2f14ed7fdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.640804:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052ed9dcc/0xecaf9f2f14ed7fdc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.640812:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052ed9dcc/0xecaf9f2f14ed7fdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.640827:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.640829:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.640831:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789264342.640950:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.640956:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000476f130b/0xecaf9f2f14ed7fe3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.640965:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.640968:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.640972:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000476f130b/0xecaf9f2f14ed7fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.640981:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000476f130b/0xecaf9f2f14ed7fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.640989:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000476f130b/0xecaf9f2f14ed7fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.640997:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000476f130b/0xecaf9f2f14ed7fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.641037:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789264342.641266:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.641272:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed7fea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.641280:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.641289:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.641293:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed7fea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.641304:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed7fea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.641311:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed7fea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.641318:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed7fea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.641386:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789264342.641392:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000476f130b/0xecaf9f2f14ed7fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.641410:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fe800 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264342.641414:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000476f130b/0xecaf9f2f14ed7fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.641422:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000476f130b/0xecaf9f2f14ed7fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.641434:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000476f130b/0xecaf9f2f14ed7fe3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.641440:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000476f130b/0xecaf9f2f14ed7fe3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.641454:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264342.641457:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed7fea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.641462:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fe000 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264342.641466:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed7fea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.641474:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed7fea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.641483:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed7fea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.641496:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.641498:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.641500:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264342.641558:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789264342.641563:0:19101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed7fea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789264342.641851:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.641856:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed7ff1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.641865:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.641868:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.641872:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed7ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.641882:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed7ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.641896:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed7ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.641904:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed7ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.641975:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264342.641981:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed7ff1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.641989:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fec00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:0.0:1789264342.641992:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed7ff1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.642000:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed7ff1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.642012:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed7ff1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.642089:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789264342.642093:0:19101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed7ff1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.642112:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264342.642113:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.642128:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264342.642150:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789264342.642423:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.642429:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002850f96c/0xecaf9f2f14ed7ff8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.642439:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.642443:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.642448:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002850f96c/0xecaf9f2f14ed7ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.642458:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002850f96c/0xecaf9f2f14ed7ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.642466:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002850f96c/0xecaf9f2f14ed7ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.642480:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002850f96c/0xecaf9f2f14ed7ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.642641:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789264342.643089:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.643097:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed7fff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.643108:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.643111:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.643115:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed7fff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.643123:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed7fff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.643130:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed7fff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.643137:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed7fff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.643203:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789264342.643210:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002850f96c/0xecaf9f2f14ed7ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.643218:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fe400 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264342.643222:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002850f96c/0xecaf9f2f14ed7ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.643231:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002850f96c/0xecaf9f2f14ed7ff8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.643250:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002850f96c/0xecaf9f2f14ed7ff8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.643258:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002850f96c/0xecaf9f2f14ed7ff8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.643276:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264342.643279:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed7fff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.643286:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fe600 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264342.643298:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed7fff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.643306:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed7fff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.643317:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed7fff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.643325:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264342.643416:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264342.643422:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264342.643437:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789264342.643442:0:19101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed7fff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.643450:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789264342.644080:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264342.644088:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8006 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.644109:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=422s v=(0 0) 00010000:00010000:0.0:1789264342.644113:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264342.644117:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8006 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.644128:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8006 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.644137:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8006 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.644145:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8006 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.644165:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789264342.644209:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264342.644215:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8006 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.644224:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cae00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264342.644228:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8006 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.644236:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.644250:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8006 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.644258:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8006 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.644280:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264342.644282:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264342.644284:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789264342.644516:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264342.644522:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b93024/0xecaf9f2f14ed800d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.644530:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=422s v=(0 0) 00010000:00010000:0.0:1789264342.644533:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264342.644538:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076b93024/0xecaf9f2f14ed800d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.644547:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076b93024/0xecaf9f2f14ed800d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.644565:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b93024/0xecaf9f2f14ed800d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.644573:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076b93024/0xecaf9f2f14ed800d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.645612:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789264342.645669:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264342.645678:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076b93024/0xecaf9f2f14ed800d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.645689:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836ca200 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264342.645693:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b93024/0xecaf9f2f14ed800d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.645703:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b93024/0xecaf9f2f14ed800d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.645721:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076b93024/0xecaf9f2f14ed800d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.645728:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076b93024/0xecaf9f2f14ed800d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.645773:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264342.645775:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264342.645776:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789264342.646299:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264342.646307:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed8014 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.646319:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=422s v=(0 0) 00010000:00010000:0.0:1789264342.646322:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264342.647587:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed8014 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.647611:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed8014 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.647622:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed8014 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.647630:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed8014 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.648085:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789264342.648455:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264342.648463:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed8014 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.648484:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cb000 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264342.648489:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed8014 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.648498:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed8014 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.648516:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed8014 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.648523:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a87803b/0xecaf9f2f14ed8014 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.648542:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264342.648544:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264342.648546:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789264342.649432:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264342.649443:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b94534/0xecaf9f2f14ed801b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.649457:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=422s v=(0 0) 00010000:00010000:0.0:1789264342.649461:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264342.649466:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b94534/0xecaf9f2f14ed801b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.649478:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2b94534/0xecaf9f2f14ed801b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.649488:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b94534/0xecaf9f2f14ed801b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.649496:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b94534/0xecaf9f2f14ed801b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264342.649521:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789264342.649945:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264342.649952:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2b94534/0xecaf9f2f14ed801b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.649961:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b200 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264342.649965:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b94534/0xecaf9f2f14ed801b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.649975:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b94534/0xecaf9f2f14ed801b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.649996:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2b94534/0xecaf9f2f14ed801b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.650004:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2b94534/0xecaf9f2f14ed801b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.650018:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264342.650020:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264342.650021:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789264342.651612:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.651623:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed8022 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.651638:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.651642:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.651648:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed8022 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.651660:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed8022 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.651669:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed8022 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.651677:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed8022 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.651731:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789264342.652216:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.652223:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8029 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.652233:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.652236:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.652246:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8029 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.652266:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8029 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.652275:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8029 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.652283:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8029 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.652449:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789264342.652456:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed8022 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.652464:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fe600 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264342.652467:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed8022 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.652476:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed8022 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.652492:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed8022 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.652499:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdaac408/0xecaf9f2f14ed8022 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.652523:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264342.652527:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8029 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.652534:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fec00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264342.652537:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8029 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.652545:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8029 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.652555:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8029 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.652561:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264342.652563:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264342.652565:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264342.652623:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789264342.652628:0:19101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8029 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.652975:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789264342.654652:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264342.654664:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8030 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.654679:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1789264342.654684:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264342.654690:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.654716:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.654726:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.654772:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8030 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.654793:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264342.655249:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264342.655265:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8030 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.655274:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36bc00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264342.655281:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8030 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.655293:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8030 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.655311:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8030 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.655322:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8030 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.655342:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.655344:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.655345:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789264342.655559:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264342.655565:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8037 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.655574:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1789264342.655577:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264342.655581:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.655591:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.655598:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.655615:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8037 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.655636:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789264342.656353:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264342.656361:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005be6229b/0xecaf9f2f14ed803e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.656372:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1789264342.656376:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264342.656380:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005be6229b/0xecaf9f2f14ed803e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.656389:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005be6229b/0xecaf9f2f14ed803e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.656397:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005be6229b/0xecaf9f2f14ed803e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.656404:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005be6229b/0xecaf9f2f14ed803e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264342.656423:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789264342.656445:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789264342.656453:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8037 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.656462:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36aa00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264342.656466:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8037 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.656477:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8037 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.656504:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8037 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.656512:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8037 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.656531:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264342.656536:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005be6229b/0xecaf9f2f14ed803e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.656543:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36be00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264342.656546:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005be6229b/0xecaf9f2f14ed803e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.656554:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005be6229b/0xecaf9f2f14ed803e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.656564:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005be6229b/0xecaf9f2f14ed803e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.656695:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005be6229b/0xecaf9f2f14ed803e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.656709:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264342.656711:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264342.656718:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789264342.657172:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.657179:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed8045 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.657189:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.657192:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.657197:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed8045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.657207:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed8045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.657215:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed8045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.657223:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed8045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.657234:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264342.657419:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264342.657431:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed8045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.657441:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fe000 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264342.657445:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed8045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.657454:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed8045 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.657470:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed8045 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.657478:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f1ba5d1/0xecaf9f2f14ed8045 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789264342.657777:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.657785:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff14b465/0xecaf9f2f14ed804c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.657795:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1789264342.657799:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264342.657799:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264342.657803:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264342.657806:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff14b465/0xecaf9f2f14ed804c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.657807:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.657814:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264342.657842:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff14b465/0xecaf9f2f14ed804c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.657851:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff14b465/0xecaf9f2f14ed804c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.657859:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff14b465/0xecaf9f2f14ed804c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.657880:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264342.657908:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264342.657914:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff14b465/0xecaf9f2f14ed804c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.657924:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9ff200 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264342.657928:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff14b465/0xecaf9f2f14ed804c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.657948:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff14b465/0xecaf9f2f14ed804c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.657960:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff14b465/0xecaf9f2f14ed804c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.657967:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff14b465/0xecaf9f2f14ed804c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.657983:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.657985:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.657986:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789264342.658321:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.658338:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8053 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.658349:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.658352:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.658356:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.658366:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.658374:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.658394:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8053 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.658407:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264342.658506:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264342.658511:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8053 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.658519:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fec00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264342.658522:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8053 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.658530:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8053 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.658543:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8053 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.658562:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8053 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.658577:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.658578:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.658580:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789264342.658894:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.658900:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078dad510/0xecaf9f2f14ed805a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.658908:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.658911:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.658915:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078dad510/0xecaf9f2f14ed805a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.658923:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078dad510/0xecaf9f2f14ed805a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.658931:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078dad510/0xecaf9f2f14ed805a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.658940:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078dad510/0xecaf9f2f14ed805a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.658960:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264342.659019:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264342.659024:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078dad510/0xecaf9f2f14ed805a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659033:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9ff600 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264342.659038:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078dad510/0xecaf9f2f14ed805a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659046:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078dad510/0xecaf9f2f14ed805a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659059:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078dad510/0xecaf9f2f14ed805a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659066:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078dad510/0xecaf9f2f14ed805a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659081:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.659083:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.659084:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789264342.659197:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.659203:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000945735be/0xecaf9f2f14ed8061 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.659217:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.659220:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.659224:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000945735be/0xecaf9f2f14ed8061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.659233:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000945735be/0xecaf9f2f14ed8061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.659241:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000945735be/0xecaf9f2f14ed8061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.659247:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000945735be/0xecaf9f2f14ed8061 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659371:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264342.659374:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789264342.659377:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000945735be/0xecaf9f2f14ed8061 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659387:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9ffc00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264342.659390:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000945735be/0xecaf9f2f14ed8061 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659399:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000945735be/0xecaf9f2f14ed8061 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659413:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000945735be/0xecaf9f2f14ed8061 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659420:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000945735be/0xecaf9f2f14ed8061 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659435:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.659437:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.659439:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789264342.659620:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.659626:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004272c4d4/0xecaf9f2f14ed8068 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.659634:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789264342.659637:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.659642:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004272c4d4/0xecaf9f2f14ed8068 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.659650:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004272c4d4/0xecaf9f2f14ed8068 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.659669:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004272c4d4/0xecaf9f2f14ed8068 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.659676:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004272c4d4/0xecaf9f2f14ed8068 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.659695:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264342.659893:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264342.659899:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004272c4d4/0xecaf9f2f14ed8068 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659908:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fea00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264342.659911:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004272c4d4/0xecaf9f2f14ed8068 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659932:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004272c4d4/0xecaf9f2f14ed8068 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659946:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004272c4d4/0xecaf9f2f14ed8068 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659953:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004272c4d4/0xecaf9f2f14ed8068 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.659967:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.659969:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.659971:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789264342.660428:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789264342.660436:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d419018/0xecaf9f2f14ed806f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.660446:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=423s v=(0 0) 00010000:00010000:1.0:1789264342.660449:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264342.660454:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d419018/0xecaf9f2f14ed806f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.660463:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d419018/0xecaf9f2f14ed806f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.660471:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d419018/0xecaf9f2f14ed806f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.660478:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d419018/0xecaf9f2f14ed806f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264342.660513:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264342.660537:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264342.660543:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d419018/0xecaf9f2f14ed806f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.660552:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fe200 already unused, calling callback (ffffffffc0e8e350) 00002000:00080000:1.0:1789264342.660554:0:19101:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00010000:00010000:2.0:1789264342.660557:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d419018/0xecaf9f2f14ed806f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.660567:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d419018/0xecaf9f2f14ed806f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.660580:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d419018/0xecaf9f2f14ed806f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.660599:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d419018/0xecaf9f2f14ed806f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264342.660615:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.660618:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264342.660620:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264342.660690:0:19101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17228:x1876179322830208:12345-0@lo:5:osp-pre-0-0.0 Request processed in 47507us (51831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264342.660699:0:19101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789264342.661401:0:17228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984659c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17228:1876179322830208:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789264342.661417:0:17228:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1789264342.661494:0:17228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17228:1876179322830336:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789264342.661536:0:17228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264342.661564:0:17228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa1b53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264342.661650:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322830336 00000100:00100000:2.0:1789264342.661657:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322830336 00000100:00100000:2.0:1789264342.661707:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789264342.661716:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17228:x1876179322830336:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789264342.661778:0:18710:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1789264342.670560:0:18706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1789264342.670656:0:18706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789264342.670957:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17228:x1876179322830336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9238us (9416us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789264342.670979:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789264342.671053:0:17228:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789264342.671060:0:17228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17228:1876179322830336:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789264342.671141:0:17228:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000020:00000004:2.0:1789264342.894479:0:19130:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789264342.894696:0:19130:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789264342.924077:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789264343.405236:0:19180:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789264343.405459:0:19180:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789264343.561956:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789264343.562650:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322830592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789264343.562816:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264343.562892:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322830464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789264343.562916:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264343.563062:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322830592 00000100:00100000:2.0:1789264343.563072:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322830592 00000100:00100000:2.0:1789264343.563119:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322830464 00000100:00100000:2.0:1789264343.563122:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322830464 00000100:00100000:2.0:1789264343.563141:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789264343.563151:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322830592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789264343.563192:0:17208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789264343.563257:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322830592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264343.563280:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789264343.563299:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789264343.563304:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322830464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789264343.563332:0:17208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1789264343.563358:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322830464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264343.563363:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789264343.563495:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322830592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789264343.563505:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322830464:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789264343.946877:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264344.972701:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264345.994077:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264347.017906:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789264347.658559:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789264347.658565:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789264347.658568:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c3aba916800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789264347.658576:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 422 00000100:00080000:2.0:1789264347.658582:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789264347.658587:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c3aba916800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1789264347.658607:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983621500 x1876179322831104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789264347.658634:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789264347.658638:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789264347.658641:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789264347.658643:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789264347.658683:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322830848:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.658778:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.658826:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322831488:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.658861:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.658883:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789264347.658889:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3623:1876179322830720:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.658915:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.658938:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322831360:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.658964:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.658991:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322830976:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.659016:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.659031:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322831616:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.659068:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.659089:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789264347.659095:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322831232:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.659116:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.659139:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322831744:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.659161:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.659188:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322831104:0@lo:8:kworker.0 00000100:00100000:2.0:1789264347.659212:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.659268:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322830848 00000100:00100000:2.0:1789264347.659274:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322830848 00000100:00100000:2.0:1789264347.659307:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322831360 00000100:00100000:2.0:1789264347.659310:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322831360 00000100:00100000:2.0:1789264347.659327:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789264347.659336:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322830848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.659381:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322830848:12345-0@lo:400:kworker.0 Request processed in 46us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264347.659388:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789264347.659415:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789264347.659422:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322831360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.659453:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322831360:12345-0@lo:400:kworker.0 Request processed in 32us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264347.659459:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789264347.659478:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322830720 00000100:00100000:2.0:1789264347.659481:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322830720 00000100:00100000:2.0:1789264347.659506:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789264347.659512:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:3623:x1876179322830720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.659540:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:3623:x1876179322830720:12345-0@lo:400:kworker.0 Request processed in 28us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264347.659546:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789264347.659570:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322831488 00000100:00100000:2.0:1789264347.659574:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322831488 00000100:00100000:2.0:1789264347.659590:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322831616 00000100:00100000:2.0:1789264347.659593:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322831616 00000100:00100000:2.0:1789264347.659618:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322831232 00000100:00100000:2.0:1789264347.659621:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322831232 00000100:00100000:3.0:1789264347.659625:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322831744 00000100:00100000:3.0:1789264347.659633:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322831744 00000100:00100000:2.0:1789264347.659638:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789264347.659647:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322831488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264347.659668:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789264347.659681:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876179322831616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.659685:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322831488:12345-0@lo:400:kworker.0 Request processed in 38us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264347.659694:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789264347.659722:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789264347.659731:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322831232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264347.659780:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876179322831616:12345-0@lo:400:kworker.0 Request processed in 67us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264347.659788:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789264347.659808:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789264347.659816:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322831744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264347.659943:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322831872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789264347.660000:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322831232:12345-0@lo:400:kworker.0 Request processed in 270us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264347.660015:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789264347.660037:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789264347.660040:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264347.660063:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3623:1876179322830720:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.660075:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322831360:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.660084:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322830848:0@lo:400:kworker.0 00010000:00080000:2.0:1789264347.660095:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983621880 x1876179322831488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264347.660104:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322831488:0@lo:400:kworker.0 00000100:00100000:3.0:1789264347.662496:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322831744:12345-0@lo:400:kworker.0 Request processed in 2673us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264347.662516:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789264347.662516:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789264347.662683:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983623100 x1876179322831232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264347.662697:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322831232:0@lo:400:kworker.0 00010000:00080000:3.0:1789264347.662722:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3a8f349500 x1876179322831744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264347.662730:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322831744:0@lo:400:kworker.0 00010000:00080000:3.0:1789264347.662770:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3a8f348700 x1876179322831616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264347.662793:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322831616:0@lo:400:kworker.0 00000100:00100000:1.0:1789264347.663213:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322830976 00000100:00100000:0.0:1789264347.663213:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322831872 00000100:00100000:1.0:1789264347.663222:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322830976 00000100:00100000:0.0:1789264347.663222:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322831872 00000100:00100000:0.0:1789264347.663777:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789264347.664320:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264347.668249:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322831872:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789264347.668275:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322831104 00000100:00100000:1.0:1789264347.668284:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322831104 00002000:00000024:0.0:1789264347.668287:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789264347.668383:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789264347.668441:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789264347.668447:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3621:x1876179322831104:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789264347.668467:0:18710:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789264347.668568:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1876179322830976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264347.668648:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1876179322831872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4862us (6138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264347.668657:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789264347.668687:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322830976:12345-0@lo:400:kworker.0 Request processed in 294us (9669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264347.668694:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789264347.668733:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322831872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789264347.669326:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322830976:0@lo:400:kworker.0 00000100:00100000:3.0:1789264347.683666:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3621:x1876179322831104:12345-0@lo:8:kworker.0 Request processed in 15209us (24444us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789264347.683680:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789264347.683784:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aba916800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789264347.683791:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789264347.683794:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322831104:0@lo:8:kworker.0 00000020:01000004:1.0:1789264347.872422:0:19525:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789264347.872426:0:19525:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789264347.872427:0:19525:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789264347.872573:0:19525:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c3984743000 00000020:01000004:1.0:1789264347.872588:0:19525:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789264347.872603:0:19525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789264347.872625:0:19525:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c398370cd28) 00000020:00000080:1.0:1789264347.872647:0:19525:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789264347.912566:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789264347.914201:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789264347.914419:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789264347.914916:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789264347.915133:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789264347.915358:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789264347.915564:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1789264347.917971:0:19525:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789264347.918169:0:19525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789264347.918184:0:19525:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789264347.918196:0:19525:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xecaf9f2f14ed807d 00000020:01000004:3.0:1789264347.918202:0:19525:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789264347.918224:0:19525:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.144@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789264347.918228:0:19525:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789264347.918234:0:19525:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789264347.918260:0:19525:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789264347.918265:0:19525:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789264347.925697:0:19525:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789264347.925841:0:19525:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.144@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789264347.925847:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789264347.925849:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789264347.925850:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789264347.925851:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789264347.925853:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789264347.925854:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789264347.925856:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789264347.925857:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789264347.925859:0:19525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789264347.925862:0:19525:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789264347.925864:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789264347.925866:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789264347.925873:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789264347.925874:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789264347.925875:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789264347.925876:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789264347.925877:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789264347.925878:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789264347.925879:0:19525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789264347.925904:0:19525:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789264347.925925:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789264347.925999:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.926127:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c398307b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264347.926165:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322832000 00000100:00100000:1.0:1789264347.926172:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322832000 00000100:00100000:1.0:1789264347.926256:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789264347.926267:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:19525:x1876179322832000:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789264347.926313:0:17198:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789264347.926316:0:17198:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789264347.926320:0:17198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789264347.926593:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:19525:x1876179322832000:12345-0@lo:253:mount.lustre.0 Request processed in 327us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264347.926602:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789264347.926669:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832000:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789264347.926685:0:19525:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789264347.926687:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789264347.926688:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789264347.926690:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789264347.926691:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789264347.926692:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789264347.926693:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789264347.926695:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789264347.926696:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789264347.926706:0:19525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789264347.926724:0:19525:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c3984743000 from lustre-OST0001 10000000:01000000:3.0:1789264347.926777:0:19525:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789264347.926780:0:19525:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789264347.926788:0:19525:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c3aba8e8000 local copy 00010000:00010000:3.0:1789264347.926798:0:19525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cda expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264347.926889:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789264347.926918:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264347.927169:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264347.927229:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322832128 00000100:00100000:2.0:1789264347.927234:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322832128 00000100:00100000:2.0:1789264347.927258:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789264347.927265:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:19525:x1876179322832128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789264347.927374:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:19525:x1876179322832128:12345-0@lo:501:mount.lustre.0 Request processed in 108us (455us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789264347.927381:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789264347.927522:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832128:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789264347.927535:0:19525:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789264347.927551:0:19525:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789264347.927558:0:19525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cda expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264347.927566:0:19525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36b800/0xecaf9f2f14ed7cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed7cda expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264347.927591:0:19525:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c3984743000 10000000:01000000:3.0:1789264347.927601:0:19525:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789264347.927606:0:19525:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789264347.927609:0:19525:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789264347.927613:0:19525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789264347.927616:0:19525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789264347.927636:0:19525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a400/0xecaf9f2f14ed8084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264347.927644:0:19525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a400/0xecaf9f2f14ed8084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264347.927652:0:19525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a400/0xecaf9f2f14ed8084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264347.927665:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789264347.927693:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264347.927725:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264347.927785:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322832256 00000100:00100000:2.0:1789264347.927790:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322832256 00000100:00100000:2.0:1789264347.927863:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789264347.927871:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:19525:x1876179322832256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789264347.927881:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264347.927892:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3abac1d200/0xecaf9f2f14ed808b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed8084 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264347.927912:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3abac1d200/0xecaf9f2f14ed808b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed8084 expref: 22 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264347.927922:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3abac1d200/0xecaf9f2f14ed808b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed8084 expref: 22 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264347.927941:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1d200, rc 0) 00000100:00100000:2.0:1789264347.927973:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:19525:x1876179322832256:12345-0@lo:101:mount.lustre.0 Request processed in 103us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264347.927979:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789264347.928043:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789264347.928055:0:19525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a400/0xecaf9f2f14ed8084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed808b expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264347.928064:0:19525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a400/0xecaf9f2f14ed8084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed808b expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789264347.928947:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789264347.929577:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789264347.931207:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789264347.931252:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789264347.931269:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789264347.931284:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789264347.931379:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789264347.931396:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789264347.931422:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789264347.931427:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789264347.931523:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789264347.931583:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264347.931620:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789264347.931709:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322832384 00000100:00100000:2.0:1789264347.931716:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322832384 00000100:00100000:2.0:1789264347.931776:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789264347.931785:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:19525:x1876179322832384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789264347.931924:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:19525:x1876179322832384:12345-0@lo:501:mount.lustre.0 Request processed in 139us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264347.931931:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789264347.932146:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789264347.932175:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832512:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789264347.932215:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264347.932267:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789264347.932329:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322832512 00000100:00100000:0.0:1789264347.932334:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322832512 00000100:00100000:0.0:1789264347.932367:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789264347.932375:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:19525:x1876179322832512:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789264347.933206:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:19525:x1876179322832512:12345-0@lo:503:mount.lustre.0 Request processed in 829us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264347.933215:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789264347.933306:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832512:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789264347.933665:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789264347.933790:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789264347.933834:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264347.933947:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264347.933957:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322832640 00000100:00100000:2.0:1789264347.933962:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322832640 00000100:00100000:2.0:1789264347.933999:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789264347.934007:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:19525:x1876179322832640:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789264347.934498:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:19525:x1876179322832640:12345-0@lo:502:mount.lustre.0 Request processed in 490us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264347.934505:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789264347.934657:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789264347.934987:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789264347.935008:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789264347.935016:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789264347.935023:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789264347.935029:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789264347.935036:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789264347.935043:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789264347.935050:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789264347.935061:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789264347.935150:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789264347.935184:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264347.935209:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ababb59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264347.935229:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322832768 00000100:00100000:0.0:1789264347.935234:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322832768 00000100:00100000:0.0:1789264347.935272:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789264347.935287:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a907c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:19525:x1876179322832768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789264347.935494:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a907c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:19525:x1876179322832768:12345-0@lo:502:mount.lustre.0 Request processed in 208us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264347.935500:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789264347.935577:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789264347.935618:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789264347.935626:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1789264347.936457:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789264347.936465:0:19529:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789264347.936470:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789264347.936472:0:19529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789264347.936478:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789264347.936492:0:19529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c3aaa493370) 00000020:00000080:3.0:1789264347.936514:0:19529:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789264347.936522:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789264347.936604:0:19529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3984743000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789264347.936612:0:19529:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789264347.936620:0:19529:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xecaf9f2f14ed8099 00010000:00010000:3.0:1789264347.942254:0:19529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789264347.942716:0:19529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:3.0:1789264347.945062:0:19529:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789264347.946917:0:19529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789264347.946929:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264347.946935:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264347.946937:0:19529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789264347.946940:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789264347.946944:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264347.946945:0:19529:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789264347.946948:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789264347.946950:0:19529:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789264347.946952:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264347.946954:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264347.946956:0:19529:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789264347.946958:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789264347.946961:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264347.946962:0:19529:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789264347.946965:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789264347.946993:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789264347.946996:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789264347.946997:0:19529:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789264347.947001:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789264347.947186:0:19525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789264347.947216:0:19525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789264347.947243:0:19525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a400/0xecaf9f2f14ed8084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed808b expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264347.947255:0:19525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a8a36a400/0xecaf9f2f14ed8084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed808b expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789264347.947276:0:19525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3984743000 from 1 10000000:01000000:2.0:1789264347.947279:0:19525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789264347.947414:0:19525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264347.947423:0:19525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264347.947435:0:19525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264347.947459:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832896:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789264347.947523:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.947592:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264347.948625:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322832896 00000100:00100000:0.0:1789264347.948635:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322832896 00000100:00100000:0.0:1789264347.948679:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789264347.948690:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a907c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:19525:x1876179322832896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789264347.948714:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264347.948729:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c398366a200/0xecaf9f2f14ed80a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed80a0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.948786:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c398366a200/0xecaf9f2f14ed80a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed80a0 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.948797:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c398366a200/0xecaf9f2f14ed80a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed80a0 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.948807:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366a200, rc 0) 00000100:00100000:0.0:1789264347.948870:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a907c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:19525:x1876179322832896:12345-0@lo:101:mount.lustre.0 Request processed in 183us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264347.948877:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789264347.949890:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322832896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789264347.949910:0:19525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed80a7 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264347.949921:0:19525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed80a7 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789264347.951126:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789264347.951392:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789264347.951582:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789264347.951606:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789264347.951622:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789264347.951626:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789264347.951687:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789264347.951886:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.951921:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789264347.953216:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322833024 00000100:00100000:0.0:1789264347.953227:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322833024 00000100:00100000:0.0:1789264347.953290:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789264347.953300:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:19525:x1876179322833024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789264347.953446:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:19525:x1876179322833024:12345-0@lo:501:mount.lustre.0 Request processed in 146us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264347.953455:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789264347.953775:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789264347.953820:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789264347.953865:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.953894:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789264347.954131:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322833152 00000100:00100000:0.0:1789264347.954136:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322833152 00000100:00100000:0.0:1789264347.954173:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789264347.954183:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:19525:x1876179322833152:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789264347.954278:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:19525:x1876179322833152:12345-0@lo:503:mount.lustre.0 Request processed in 97us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264347.954286:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789264347.954389:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833152:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789264347.954790:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789264347.954851:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264347.954891:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264347.954911:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c48ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789264347.954976:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322833280 00000100:00100000:2.0:1789264347.954981:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322833280 00000100:00100000:2.0:1789264347.955046:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789264347.955054:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:19525:x1876179322833280:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789264347.955136:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:19525:x1876179322833280:12345-0@lo:502:mount.lustre.0 Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264347.955143:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789264347.955479:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789264347.955646:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789264347.955672:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789264347.955689:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789264347.955718:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789264347.955735:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789264347.955852:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789264347.955870:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789264347.955882:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789264347.955895:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789264347.955907:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789264347.955920:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789264347.955945:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f34ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789264347.955988:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.956061:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52840 going to sleep for 11 seconds 00000100:00100000:1.0:1789264347.956097:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322833408 00000100:00100000:1.0:1789264347.956102:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322833408 00000100:00100000:1.0:1789264347.956167:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789264347.956176:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:19525:x1876179322833408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264347.956314:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:19525:x1876179322833408:12345-0@lo:502:mount.lustre.0 Request processed in 139us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264347.956321:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789264347.956446:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f34ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789264347.956495:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789264347.956503:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789264347.958124:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264347.958135:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264347.958137:0:19533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789264347.958145:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c3984743000 00000020:00000080:2.0:1789264347.958147:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789264347.958155:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264347.958157:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264347.958159:0:19533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789264347.958161:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264347.958164:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264347.958165:0:19533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789264347.958168:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c3984743000 00000020:00000080:2.0:1789264347.958171:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789264347.958259:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264347.958264:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264347.958265:0:19533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789264347.958268:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264347.958271:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264347.958272:0:19533:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789264347.958275:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c3984743000 00000020:00000080:2.0:1789264347.958277:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789264347.964667:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264347.964681:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264347.964683:0:19533:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789264347.964689:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789264347.964693:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264347.964694:0:19533:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789264347.964709:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c3984743000 00000020:00000080:2.0:1789264347.964712:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789264347.964786:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789264347.964790:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789264347.964791:0:19533:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789264347.964795:0:19533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1789264347.964940:0:19525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789264347.964975:0:19525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789264347.965005:0:19525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed80a7 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.965018:0:19525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed80a7 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264347.965077:0:19525:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789264347.965080:0:19525:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c3984743000 10000000:01000000:0.0:1789264347.965083:0:19525:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c3984743000 10000000:01000000:0.0:1789264347.965086:0:19525:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789264347.965092:0:19525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c3984743000 from 1 10000000:01000000:0.0:1789264347.965095:0:19525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789264347.965127:0:19525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366aa00/0xecaf9f2f14ed80ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.965136:0:19525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c398366aa00/0xecaf9f2f14ed80ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.965148:0:19525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c398366aa00/0xecaf9f2f14ed80ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264347.965170:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833536:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789264347.965235:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264347.965285:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8922c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789264347.965323:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322833536 00000100:00100000:2.0:1789264347.965331:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322833536 00000100:00100000:2.0:1789264347.965377:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789264347.965386:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:19525:x1876179322833536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789264347.965398:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264347.965410:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3abac1ce00/0xecaf9f2f14ed80b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed80ae expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264347.965432:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3abac1ce00/0xecaf9f2f14ed80b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed80ae expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264347.965443:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3abac1ce00/0xecaf9f2f14ed80b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed80ae expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264347.965453:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1ce00, rc 0) 00000100:00100000:2.0:1789264347.965498:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:19525:x1876179322833536:12345-0@lo:101:mount.lustre.0 Request processed in 114us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264347.965506:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789264347.965531:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833536:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789264347.965546:0:19525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c398366aa00/0xecaf9f2f14ed80ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed80b5 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.965555:0:19525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c398366aa00/0xecaf9f2f14ed80ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed80b5 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789264347.966932:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1789264347.967190:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789264347.967426:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789264347.967463:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789264347.967480:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789264347.967492:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789264347.967503:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789264347.967516:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789264347.967530:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789264347.967543:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789264347.967554:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789264347.967566:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789264347.967578:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789264347.967591:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789264347.967605:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789264347.967619:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789264347.967637:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789264347.967651:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789264347.967664:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789264347.967693:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789264347.967724:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789264347.967738:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789264347.967777:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789264347.967790:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789264347.967818:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789264347.967835:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789264347.967848:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1789264347.967861:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1789264347.967874:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1789264347.967886:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1789264347.967899:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1789264347.967930:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1789264347.967950:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1789264347.967971:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1789264347.967988:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1789264347.968020:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1789264347.968036:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1789264347.968047:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1789264347.968060:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1789264347.968072:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1789264347.968086:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1789264347.968103:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1789264347.968118:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1789264347.968138:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1789264347.968156:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1789264347.968173:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1789264347.968187:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1789264347.968201:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1789264347.968222:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1789264347.968228:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1789264347.968309:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789264347.968367:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264347.968412:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab267a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789264347.969463:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322833664 00000100:00100000:1.0:1789264347.969472:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322833664 00000100:00100000:1.0:1789264347.969553:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789264347.969563:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:19525:x1876179322833664:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789264347.969732:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:19525:x1876179322833664:12345-0@lo:501:mount.lustre.0 Request processed in 159us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264347.969739:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789264347.970119:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789264347.970169:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789264347.970287:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264347.970319:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322833792 00000100:00100000:3.0:1789264347.970323:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322833792 00000100:00100000:3.0:1789264347.970352:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789264347.970369:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:19525:x1876179322833792:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789264347.970610:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:19525:x1876179322833792:12345-0@lo:503:mount.lustre.0 Request processed in 86us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264347.970620:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789264347.970740:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264347.970842:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833792:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789264347.971970:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789264347.972122:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789264347.972183:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264347.972284:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264347.972412:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322833920 00000100:00100000:2.0:1789264347.972419:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322833920 00000100:00100000:2.0:1789264347.972462:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789264347.972472:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:19525:x1876179322833920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789264347.972592:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:19525:x1876179322833920:12345-0@lo:502:mount.lustre.0 Request processed in 122us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264347.972599:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789264347.972842:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322833920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789264347.973296:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789264347.973328:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789264347.973348:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789264347.973365:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789264347.973388:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789264347.973412:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789264347.973432:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789264347.973616:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789264347.973641:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789264347.973804:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789264347.973821:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789264347.973835:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789264347.973914:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789264347.973932:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789264347.973945:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789264347.973970:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789264347.973986:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789264347.974010:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789264347.974098:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789264347.974109:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789264347.974121:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789264347.974131:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789264347.974141:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789264347.974152:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789264347.974162:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1789264347.974173:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1789264347.974196:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1789264347.974207:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1789264347.974228:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1789264347.974240:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1789264347.974252:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1789264347.974277:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1789264347.974290:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1789264347.974302:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1789264347.974312:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1789264347.974323:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1789264347.974334:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1789264347.974345:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1789264347.974356:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1789264347.974367:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1789264347.974378:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1789264347.974387:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1789264347.974398:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1789264347.974409:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1789264347.974421:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1789264347.974433:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1789264347.974445:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1789264347.975194:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1789264347.975270:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322834048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789264347.975349:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264347.975448:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264347.976172:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322834048 00000100:00100000:0.0:1789264347.976181:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322834048 00000100:00100000:0.0:1789264347.976238:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789264347.976248:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:19525:x1876179322834048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789264347.976373:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:19525:x1876179322834048:12345-0@lo:502:mount.lustre.0 Request processed in 126us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264347.976382:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789264347.976825:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322834048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789264347.977786:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789264347.977820:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789264347.978085:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322834176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789264347.978139:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264347.978175:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264347.978576:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322834176 00000100:00100000:1.0:1789264347.978583:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322834176 00000100:00100000:1.0:1789264347.978633:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789264347.978643:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:19525:x1876179322834176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789264347.978911:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:19525:x1876179322834176:12345-0@lo:502:mount.lustre.0 Request processed in 268us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264347.978919:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789264347.978951:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c398465a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322834176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789264347.979028:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789264347.979042:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789264347.981510:0:19538:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789264347.981525:0:19538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c3983708000) 00000020:00000080:1.0:1789264347.981549:0:19538:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789264347.981637:0:19538:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3984743000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789264347.981641:0:19538:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c3984743000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789264347.981643:0:19538:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3984743000 3 00010000:00080000:1.0:1789264347.981679:0:19538:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3982581000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.144@tcp at head 00010000:00010000:1.0:1789264347.985394:0:19538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1789264347.985626:0:19538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789264347.985673:0:19538:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789264347.985686:0:19538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xecaf9f2f14ed80c3 00000100:00080000:1.0:1789264347.985696:0:19538:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789264347.985712:0:19538:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c3982581000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264347.985770:0:19538:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f53b80 x1876179322834304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789264347.985793:0:19538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:1.0:1789264347.985973:0:19538:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789264347.985994:0:19538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c398370b370) 00000020:00000080:1.0:1789264347.986011:0:19538:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1789264347.986107:0:19538:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c3984743000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789264347.986111:0:19538:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c3984743000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789264347.986114:0:19538:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c3984743000 3 00010000:00080000:1.0:1789264347.986144:0:19538:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c3982580800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.144@tcp at head 00000100:00100000:0.0:1789264347.986521:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1876179322834304:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789264347.986591:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789264347.986680:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789264347.986684:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789264347.986686:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c3aba916800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789264347.986691:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 427 00000100:00080000:0.0:1789264347.986694:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789264347.986710:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c3aba916800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1789264347.986726:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c39847a6d80 x1876179322834560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789264347.986788:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789264347.986792:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789264347.986794:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789264347.986797:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789264347.986831:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322834432:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.986959:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322834304 00000100:00100000:2.0:1789264347.986965:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322834304 00000100:00100000:2.0:1789264347.986997:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789264347.987005:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3621:x1876179322834304:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789264347.987026:0:18643:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:2.0:1789264347.987059:0:18643:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xecaf9f2f14ed80d1 00000004:00100000:2.0:1789264347.987072:0:18643:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789264347.987100:0:18643:0:(import.c:65:import_set_state_nolock()) ffff9c3abaf0b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789264347.987146:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.987198:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876179322834304:12345-0@lo:38:llog_process_th.0 Request processed in 190us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264347.987206:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789264347.987240:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322835072:0@lo:400:kworker.0 00000100:00100000:0.0:1789264347.987265:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264347.987288:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789264347.987294:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322834944:0@lo:400:kworker.0 00000100:00100000:0.0:1789264347.987321:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264347.987351:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322834688:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.987363:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322835072 00000100:00100000:2.0:1789264347.987368:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322835072 00000100:00100000:0.0:1789264347.987376:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264347.987392:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322835200:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.987393:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322834944 00000100:00100000:2.0:1789264347.987396:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322834944 00000100:00100000:2.0:1789264347.987408:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322834688 00000100:00100000:2.0:1789264347.987410:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322834688 00000100:00100000:2.0:1789264347.987423:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789264347.987423:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.987429:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322835072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264347.987437:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789264347.987441:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322834816:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.987466:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322835072:12345-0@lo:400:kworker.0 Request processed in 37us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264347.987471:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.987473:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789264347.987485:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322835200 00000100:00100000:2.0:1789264347.987488:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322835200 00000100:00100000:0.0:1789264347.987503:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322834432 00000100:00100000:2.0:1789264347.987504:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789264347.987506:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322834432 00000100:00100000:2.0:1789264347.987510:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322834944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264347.987527:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322834816 00000100:00100000:0.0:1789264347.987530:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322834816 00000100:00100000:2.0:1789264347.987538:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322834944:12345-0@lo:400:kworker.0 Request processed in 29us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264347.987546:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789264347.987552:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322834432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.987553:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789264347.987564:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789264347.987570:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322834688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264347.987583:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322834432:12345-0@lo:400:kworker.0 Request processed in 31us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264347.987589:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789264347.987594:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322834688:12345-0@lo:400:kworker.0 Request processed in 25us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264347.987599:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789264347.987602:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789264347.987608:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789264347.987608:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322834816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.987613:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322835200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.987635:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322835200:12345-0@lo:400:kworker.0 Request processed in 21us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264347.987635:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322834816:12345-0@lo:400:kworker.0 Request processed in 26us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264347.987641:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789264347.987641:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789264347.987666:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322834560:0@lo:8:kworker.0 00000100:00100000:0.0:1789264347.987696:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789264347.987767:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983f53b80 x1876179322834304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789264357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264347.987778:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789264347.987785:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789264347.987792:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789264347.987797:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789264347.987805:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3982581000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789264347.987812:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1876179322834304:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789264347.987849:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322834816:0@lo:400:kworker.0 00010000:00080000:0.0:1789264347.987858:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c39847a5180 x1876179322834688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264347.987865:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322834688:0@lo:400:kworker.0 00010000:00080000:0.0:1789264347.987874:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3abab41f80 x1876179322835200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264347.987881:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322835200:0@lo:400:kworker.0 00010000:00080000:0.0:1789264347.987906:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c39847a6a00 x1876179322834944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264347.987914:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322834944:0@lo:400:kworker.0 00000100:00100000:0.0:1789264347.987923:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322834432:0@lo:400:kworker.0 00010000:00080000:0.0:1789264347.987931:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3abab40a80 x1876179322835072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264347.987939:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322835072:0@lo:400:kworker.0 00000100:00100000:2.0:1789264347.988213:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322834560 00000100:00100000:2.0:1789264347.988219:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322834560 00000100:00100000:2.0:1789264347.988252:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789264347.988258:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3621:x1876179322834560:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789264347.988385:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3621:x1876179322834560:12345-0@lo:8:kworker.0 Request processed in 125us (686us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789264347.988392:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789264347.988408:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789264347.988413:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aba916800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789264347.988417:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789264347.988421:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322834560:0@lo:8:kworker.0 00010000:00010000:1.0:1789264347.990473:0:19538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1789264347.990663:0:19538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789264347.992094:0:19538:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789264347.992110:0:19538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xecaf9f2f14ed80d8 00000100:00080000:1.0:1789264347.992122:0:19538:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789264347.992129:0:19538:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c3982580800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264347.992164:0:19538:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f53100 x1876179322835328/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789264347.992193:0:19538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1789264347.992404:0:19538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1789264347.992463:0:19525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789264347.992508:0:19525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789264347.992526:0:19525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366aa00/0xecaf9f2f14ed80ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed80b5 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264347.992538:0:19525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c398366aa00/0xecaf9f2f14ed80ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed80b5 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789264347.992584:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789264347.992591:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789264347.992592:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789264347.992593:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789264347.992594:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789264347.992596:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789264347.992597:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789264347.992599:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789264347.992600:0:19525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789264347.992603:0:19525:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789264347.992606:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789264347.992607:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789264347.992608:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789264347.992609:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789264347.992706:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789264347.992708:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789264347.992709:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789264347.992710:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789264347.992710:0:19525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789264347.992726:0:19525:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789264347.992767:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f34a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322835456:0@lo:253:mount.lustre.0 00000100:00080000:0.0:1789264347.992791:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789264347.992805:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789264347.992808:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789264347.992811:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789264347.992835:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3621:1876179322835328:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789264347.992844:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.992882:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c6be780 going to sleep for 11 seconds 00000100:00100000:0.0:1789264347.992886:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264347.992912:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322835456 00000100:00100000:2.0:1789264347.992919:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322835456 00000100:00100000:2.0:1789264347.992961:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789264347.992970:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:19525:x1876179322835456:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789264347.992995:0:17199:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789264347.993008:0:17199:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789264347.993123:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322835328 00000100:00100000:1.0:1789264347.993128:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322835328 00000100:00100000:1.0:1789264347.993183:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789264347.993190:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1876179322835328:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789264347.993214:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:1.0:1789264347.993249:0:17205:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xecaf9f2f14ed80df 00000004:00100000:1.0:1789264347.993262:0:17205:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789264347.993293:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9c3982585000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789264347.993343:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876179322835328:12345-0@lo:38:llog_process_th.0 Request processed in 152us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264347.993350:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789264347.993408:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c3983f53100 x1876179322835328/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789264357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264347.993419:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789264347.993426:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789264347.993432:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789264347.993436:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789264347.993439:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3982580800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789264347.993444:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3621:1876179322835328:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1789264347.996765:0:17199:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789264347.996779:0:17199:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789264347.996841:0:17219:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789264347.996845:0:17219:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789264347.996864:0:17219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.996880:0:17219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3abac1d600/0xecaf9f2f14ed7f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f8f expref: 24 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.996887:0:17219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c39836caa00/0xecaf9f2f14ed7fa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f9d expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.996894:0:17219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.996934:0:17219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c39836caa00/0xecaf9f2f14ed7fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed7f9d expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.996948:0:17219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c39836caa00/0xecaf9f2f14ed7fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f9d expref: 24 pid: 17198 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264347.996961:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17219:1876179322835584:0@lo:104: 00000100:00100000:0.0:1789264347.997019:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789264347.997067:0:17219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3abac1d600/0xecaf9f2f14ed7f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed7f8f expref: 24 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997076:0:17219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3abac1d600/0xecaf9f2f14ed7f96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f8f expref: 24 pid: 17196 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264347.997083:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17219:1876179322835712:0@lo:104: 00000100:00100000:0.0:1789264347.997102:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264347.997120:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab267a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264347.997138:0:18737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322835584 00000100:00100000:0.0:1789264347.997144:0:18737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322835584 00000100:00100000:0.0:1789264347.997181:0:18737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322835712 00000100:00100000:0.0:1789264347.997183:0:18737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322835712 00000100:00100000:0.0:1789264347.997197:0:18737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264347.997203:0:18737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+4:17219:x1876179322835584:12345-0@lo:104: 00010000:00010000:0.0:1789264347.997214:0:18737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7fa4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997258:0:18737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789264347.997264:0:18737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+4:17219:x1876179322835584:12345-0@lo:104: Request processed in 60us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264347.997275:0:18737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264347.997292:0:18737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264347.997298:0:18737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+3:17219:x1876179322835712:12345-0@lo:104: 00010000:00010000:0.0:1789264347.997311:0:18737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7f96 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997344:0:18737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789264347.997349:0:18737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+3:17219:x1876179322835712:12345-0@lo:104: Request processed in 52us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264347.997355:0:18737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264347.997392:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17219:1876179322835584:0@lo:104: 00000100:00100000:0.0:1789264347.997401:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17219:1876179322835712:0@lo:104: 00010000:00010000:0.0:1789264347.997418:0:17219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997432:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789264347.997437:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7fa4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997443:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1da00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264347.997447:0:18738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed7fa4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997454:0:18738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed7fa4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264347.997461:0:18738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed7fa4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264347.997473:0:18738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789264347.997500:0:18738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7fa4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997507:0:18738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264347.997523:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7fa4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997530:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3abac1da00/0xecaf9f2f14ed7f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7fa4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997539:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264347.997542:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7f96 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997547:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836ca600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1789264347.997550:0:18738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed7f96 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997556:0:18738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed7f96 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264347.997562:0:18738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed7f96 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264347.997567:0:18738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789264347.997577:0:18738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7f96 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997582:0:18738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789264347.997601:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7f96 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997607:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c39836ca600/0xecaf9f2f14ed7f8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7f96 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997621:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264347.997622:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264347.997624:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264347.997630:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264347.997648:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3622:1876179322835968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264347.997675:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264347.997893:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322835968 00000100:00100000:0.0:1789264347.997896:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322835968 00010000:00010000:0.0:1789264347.997911:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3abac1d600/0xecaf9f2f14ed7f96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f8f expref: 25 pid: 17196 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264347.997933:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264347.997941:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+25:3622:x1876179322835968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264347.997950:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264347.997956:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3abac1d600/0xecaf9f2f14ed7f96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f8f expref: 25 pid: 17196 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997966:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3abac1d600/0xecaf9f2f14ed7f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f8f expref: 25 pid: 17196 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997978:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3abac1d600/0xecaf9f2f14ed7f96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f8f expref: 25 pid: 17196 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264347.997989:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789264347.998032:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:3622:x1876179322835968:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264347.998038:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264347.998059:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3625:1876179322835840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264347.998083:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264347.998123:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322835840 00000100:00100000:3.0:1789264347.998127:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322835840 00010000:00010000:3.0:1789264347.998142:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c39836caa00/0xecaf9f2f14ed7fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f9d expref: 24 pid: 17198 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264347.998163:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789264347.998169:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:3625:x1876179322835840:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264347.998174:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:19525:x1876179322835456:12345-0@lo:253:mount.lustre.0 Request processed in 5206us (5334us total) trans 0 rc 0/0 00010000:00010000:3.0:1789264347.998177:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264347.998181:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c39836caa00/0xecaf9f2f14ed7fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f9d expref: 24 pid: 17198 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264347.998182:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00010000:3.0:1789264347.998189:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c39836caa00/0xecaf9f2f14ed7fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f9d expref: 24 pid: 17198 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264347.998198:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c39836caa00/0xecaf9f2f14ed7fa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f9d expref: 23 pid: 17198 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264347.998209:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264347.998216:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264347.998223:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f34a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:19525:1876179322835456:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789264347.998233:0:19525:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789264347.998235:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 20000000:01000000:3.0:1789264347.998237:0:17189:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012405191s 00000020:01000004:0.0:1789264347.998237:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789264347.998238:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789264347.998240:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:3.0:1789264347.998241:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789264347.998241:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789264347.998242:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789264347.998244:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789264347.998246:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789264347.998247:0:19525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1789264347.998248:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264347.998254:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1789264347.998259:0:19525:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789264347.998260:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264347.998265:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366a800 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264347.998268:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264347.998275:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264347.998289:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264347.998297:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264347.998327:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:3625:x1876179322835840:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264347.998333:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789264347.998355:0:17219:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264347.998366:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3622:1876179322835968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789264347.998372:0:17219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264347.998378:0:17219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c398366a800/0xecaf9f2f14ed80e6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264347.998399:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3625:1876179322835840:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789264348.014894:0:19525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789264348.017445:0:19525:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789264348.017455:0:19525:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789264348.017495:0:19525:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789264348.017536:0:19525:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789264348.017555:0:19525:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789264348.017578:0:19525:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789264348.025146:0:19525:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789264348.025392:0:19525:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789264348.044471:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789264348.638085:0:19592:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789264348.638316:0:19592:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789264348.685831:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322836096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789264348.685900:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264348.685958:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322836096 00000100:00100000:1.0:1789264348.685965:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322836096 00000100:00100000:1.0:1789264348.686008:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789264348.686017:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322836096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789264348.686047:0:17208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1789264348.686090:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322836096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264348.686097:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789264348.686140:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322836096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789264348.686314:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789264348.686325:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322836224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789264348.686354:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264348.686430:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322836224 00000100:00100000:1.0:1789264348.686434:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322836224 00000100:00100000:1.0:1789264348.686467:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789264348.686474:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322836224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789264348.686491:0:17208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789264348.686525:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322836224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264348.686531:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789264348.686561:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322836224:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789264349.067133:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789264349.323540:0:17239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1789264349.963353:0:17201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789264349.963362:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c39835f3800 from 10 10000000:01000000:2.0:1789264349.963367:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789264349.963409:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3abac1d800/0xecaf9f2f14ed80ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264349.963420:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3abac1d800/0xecaf9f2f14ed80ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264349.963432:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3abac1d800/0xecaf9f2f14ed80ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264349.963469:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322836352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789264349.963532:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264349.963576:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa443480 going to sleep for 11 seconds 00000100:00100000:1.0:1789264349.963783:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322836352 00000100:00100000:1.0:1789264349.963791:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322836352 00000100:00100000:1.0:1789264349.963842:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789264349.963861:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:17201:x1876179322836352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789264349.963874:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264349.963887:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3abb9fee00/0xecaf9f2f14ed80f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed80ed expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264349.963912:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3abb9fee00/0xecaf9f2f14ed80f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed80ed expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264349.963923:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3abb9fee00/0xecaf9f2f14ed80f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed80ed expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264349.963932:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abb9fee00, rc 0) 00000100:00100000:1.0:1789264349.963986:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:17201:x1876179322836352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264349.963993:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789264349.964709:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322836352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264349.964728:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3abac1d800/0xecaf9f2f14ed80ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed80f4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264349.964738:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3abac1d800/0xecaf9f2f14ed80ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed80f4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264349.964814:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3984659c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322836480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789264349.964856:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264349.964914:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322836480 00000100:00100000:2.0:1789264349.964920:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322836480 00000100:00100000:2.0:1789264349.964961:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789264349.964969:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:17201:x1876179322836480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789264349.964983:0:17199:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789264349.965000:0:17199:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789264349.965004:0:17199:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789264349.965079:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:17201:x1876179322836480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264349.965086:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789264349.965202:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3abab093c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264349.965218:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3984659c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322836480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789264349.965290:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789264349.965297:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3abac1d800/0xecaf9f2f14ed80ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed80f4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264349.965306:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3abac1d800/0xecaf9f2f14ed80ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed80f4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264349.965316:0:17201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789264349.965319:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c3983f5f000 from 10 10000000:01000000:1.0:1789264349.965321:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789264349.965341:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3abb9ffe00/0xecaf9f2f14ed80fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264349.965359:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3abb9ffe00/0xecaf9f2f14ed80fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264349.965368:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3abb9ffe00/0xecaf9f2f14ed80fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264349.965382:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322836608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789264349.965409:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264349.965431:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264349.966580:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322836608 00000100:00100000:2.0:1789264349.966588:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322836608 00000100:00100000:2.0:1789264349.966627:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789264349.966635:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:17201:x1876179322836608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789264349.966653:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264349.966668:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3abac1d400/0xecaf9f2f14ed8102 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed80fb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264349.966699:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3abac1d400/0xecaf9f2f14ed8102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed80fb expref: 24 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264349.966708:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3abac1d400/0xecaf9f2f14ed8102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed80fb expref: 24 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264349.966717:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1d400, rc 0) 00000100:00100000:2.0:1789264349.966781:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:17201:x1876179322836608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264349.966788:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789264349.966950:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322836608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789264349.966966:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3abb9ffe00/0xecaf9f2f14ed80fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed8102 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264349.966975:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3abb9ffe00/0xecaf9f2f14ed80fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed8102 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264349.967032:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322836736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789264349.967073:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264349.967114:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264349.967164:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322836736 00000100:00100000:2.0:1789264349.967169:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322836736 00000100:00100000:2.0:1789264349.967199:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789264349.967206:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:17201:x1876179322836736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789264349.967218:0:17199:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789264349.967233:0:17199:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789264349.967235:0:17199:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789264349.967333:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:17201:x1876179322836736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264349.967340:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789264349.967355:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322836736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789264349.967409:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789264349.967417:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3abb9ffe00/0xecaf9f2f14ed80fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed8102 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264349.967425:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3abb9ffe00/0xecaf9f2f14ed80fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed8102 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264350.090162:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789264350.544495:0:17956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789264351.113903:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264352.073853:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789264337/real 1789264337] req@ffff9c3983f51180 x1876179322824320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264352 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264352.073887:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c3983f51180 x1876179322824320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264352 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264352.073919:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789264337/real 1789264337] req@ffff9c3983f50700 x1876179322824448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264352 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264352.073934:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c3983f50700 x1876179322824448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789264352 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789264352.073952:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3a844f8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789264352.073975:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789264352.073980:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322824320:0@lo:8:kworker.0 00000100:00080000:0.0:1789264352.073985:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3a8455f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789264352.073990:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789264352.073993:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322824448:0@lo:8:kworker.0 00000100:00100000:0.0:1789264352.074430:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3625:1876179322836864:0@lo:400:kworker.0 00000100:00100000:0.0:1789264352.074493:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264352.074578:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322836864 00000100:00100000:2.0:1789264352.074586:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322836864 00000100:00100000:2.0:1789264352.074636:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789264352.074648:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:3625:x1876179322836864:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789264352.074787:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264352.074792:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789264352.074795:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c3aba916800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789264352.074802:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c3aba916800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264352.074822:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f52a00 x1876179322837248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789264352.076032:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:3625:x1876179322836864:12345-0@lo:400:kworker.0 Request processed in 1383us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264352.076043:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1789264352.076566:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264352.076571:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789264352.076574:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c3a844f8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789264352.076579:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 417 00000100:00080000:1.0:1789264352.076584:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789264352.076590:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c3a844f8000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264352.076609:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f52300 x1876179322837632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789264352.076620:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789264352.076623:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789264352.076625:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c3a8455f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789264352.076628:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 417 00000100:00080000:1.0:1789264352.076631:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789264352.076635:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c3a8455f800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1789264352.076647:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c3983f50a80 x1876179322837760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789264352.076727:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322837376:0@lo:400:kworker.0 00000100:00100000:3.0:1789264352.077902:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322837120:0@lo:400:kworker.0 00000100:00100000:3.0:1789264352.081361:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264352.081408:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322838016:0@lo:400:kworker.0 00000100:00100000:3.0:1789264352.081564:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264352.081602:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789264352.081610:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322836992:0@lo:400:kworker.0 00000100:00100000:3.0:1789264352.081711:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264352.081734:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322837888:0@lo:400:kworker.0 00000100:00100000:3.0:1789264352.081782:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264352.081803:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322838400:0@lo:400:kworker.0 00000100:00100000:3.0:1789264352.081831:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264352.081864:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322838016 00000100:00100000:3.0:1789264352.081871:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322838016 00000100:00100000:3.0:1789264352.081920:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322837888 00000100:00100000:3.0:1789264352.081923:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322837888 00000100:00100000:3.0:1789264352.081937:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322838400 00000100:00100000:3.0:1789264352.081939:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322838400 00000100:00100000:3.0:1789264352.081961:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789264352.081969:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322838016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264352.082090:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1876179322838016:12345-0@lo:400:kworker.0 Request processed in 121us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264352.082110:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789264352.082278:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789264352.082285:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322837888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264352.082318:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322837888:12345-0@lo:400:kworker.0 Request processed in 32us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264352.082334:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789264352.082349:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789264352.082355:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1876179322838400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264352.082385:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1876179322838400:12345-0@lo:400:kworker.0 Request processed in 30us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264352.082392:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789264352.082413:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789264352.082615:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789264352.082714:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983f51880 x1876179322837888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264352.082728:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322837888:0@lo:400:kworker.0 00010000:00080000:3.0:1789264352.082739:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983f48e00 x1876179322838400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264352.082771:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322838400:0@lo:400:kworker.0 00010000:00080000:3.0:1789264352.082783:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983f4b100 x1876179322838016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264352.082791:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1876179322838016:0@lo:400:kworker.0 00000100:00100000:0.0:1789264352.083344:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3625:1876179322836864:0@lo:400:kworker.0 00000100:00100000:0.0:1789264352.083380:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322837248:0@lo:8:kworker.0 00000100:00100000:0.0:1789264352.083536:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264352.083569:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322837632:0@lo:8:kworker.0 00000100:00100000:0.0:1789264352.083592:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264352.083709:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322837120 00000100:00100000:3.0:1789264352.083714:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322837120 00000100:00100000:3.0:1789264352.083777:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322837248 00000100:00100000:3.0:1789264352.083780:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322837248 00000100:00100000:3.0:1789264352.083789:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322837632 00000100:00100000:3.0:1789264352.083791:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322837632 00000100:00100000:3.0:1789264352.083802:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789264352.083810:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322837120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264352.083861:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322837120:12345-0@lo:400:kworker.0 Request processed in 52us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264352.083869:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789264352.083885:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789264352.083889:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3621:x1876179322837248:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789264352.083914:0:18710:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:3.0:1789264352.083939:0:18710:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xecaf9f2f14ed8109 00002000:00100000:3.0:1789264352.083952:0:18710:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c39846a8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789264352.083956:0:18710:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789264352.083959:0:18710:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789264352.084108:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322837760:0@lo:8:kworker.0 00000100:00100000:0.0:1789264352.084205:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264352.084236:0:19101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322837760 00000100:00100000:0.0:1789264352.084240:0:19101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322837760 00000100:00100000:0.0:1789264352.084253:0:19101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264352.084258:0:19101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3621:x1876179322837632:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789264352.084281:0:19101:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:0.0:1789264352.084296:0:19101:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xecaf9f2f14ed8110 00002000:00100000:0.0:1789264352.084302:0:19101:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c398379c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789264352.084306:0:19101:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1789264352.084307:0:19101:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789264352.084363:0:19101:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789264352.084386:0:19101:0:(import.c:65:import_set_state_nolock()) ffff9c398379c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789264352.084694:0:19101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3621:x1876179322837632:12345-0@lo:8:kworker.0 Request processed in 433us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264352.084701:0:19101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789264352.084715:0:19101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264352.084719:0:19101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3621:x1876179322837760:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789264352.084735:0:19101:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:0.0:1789264352.084769:0:19101:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xecaf9f2f14ed8117 00002000:00100000:0.0:1789264352.084776:0:19101:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c398379b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789264352.084779:0:19101:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1789264352.084781:0:19101:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789264352.084803:0:19101:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789264352.084814:0:19101:0:(import.c:65:import_set_state_nolock()) ffff9c398379d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789264352.084841:0:19101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3621:x1876179322837760:12345-0@lo:8:kworker.0 Request processed in 120us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264352.084847:0:19101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264352.084880:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789264352.084887:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789264352.084894:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789264352.084899:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789264352.084908:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3a844f8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789264352.084922:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789264352.084927:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322837632:0@lo:8:kworker.0 00010000:00080000:0.0:1789264352.084943:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983f50a80 x1876179322837760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789264372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264352.084952:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789264352.084955:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789264352.084960:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789264352.084963:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789264352.084965:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3a8455f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789264352.084986:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789264352.084990:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1876179322837760:0@lo:8:kworker.0 00002000:00080000:3.0:1789264352.085239:0:18710:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789264352.085255:0:18710:0:(import.c:65:import_set_state_nolock()) ffff9c39846ad800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789264352.085287:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1876179322837248:12345-0@lo:8:kworker.0 Request processed in 1396us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264352.085294:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1789264352.085342:0:17945:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789264352.085359:0:17945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17945:1876179322838656:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789264352.085387:0:17945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264352.085402:0:17945:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a88d02180 going to sleep for 11 seconds 00000004:00080000:0.0:1789264352.085812:0:17944:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789264352.085873:0:19101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322838656 00000100:00100000:3.0:1789264352.085878:0:19101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322838656 00000100:00100000:3.0:1789264352.085911:0:19101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789264352.085918:0:19101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17945:x1876179322838656:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1789264352.086063:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264352.086092:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322838144:0@lo:400:kworker.0 00000100:00100000:1.0:1789264352.086126:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789264352.086180:0:17944:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 432427434628ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789264352.086189:0:17944:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:0.0:1789264352.086286:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983f52a00 x1876179322837248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789264377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789264352.086290:0:17947:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00080000:0.0:1789264352.086305:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789264352.086312:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:2.0:1789264352.086313:0:17947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f34b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17947:1876179322838912:0@lo:7:osp-pre-1-1.0 00000100:00080000:0.0:1789264352.086318:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789264352.086322:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9c3aba916800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789264352.086336:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789264352.086341:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1876179322837248:0@lo:8:kworker.0 00000100:00100000:2.0:1789264352.086350:0:17947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264352.086366:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322837504:0@lo:400:kworker.0 00000100:00100000:2.0:1789264352.086371:0:17947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a83ea9900 going to sleep for 11 seconds 00000040:00080000:2.0:1789264352.086403:0:17229:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 9 count 2 00000100:00100000:0.0:1789264352.086404:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264352.086429:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322838272:0@lo:400:kworker.0 00000040:00080000:2.0:1789264352.086439:0:17229:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789264352.086446:0:17229:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1789264352.086467:0:17229:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789264352.086503:0:17229:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 432427758596ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789264352.086509:0:17229:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789264352.086985:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322838912 00000100:00100000:3.0:1789264352.086991:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322838912 00000100:00100000:0.0:1789264352.087185:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264352.087278:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322837376 00000100:00100000:0.0:1789264352.087283:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322837376 00000100:00100000:0.0:1789264352.087307:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322838144 00000100:00100000:0.0:1789264352.087310:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322838144 00000100:00100000:0.0:1789264352.087326:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322838272 00000100:00100000:0.0:1789264352.087329:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322838272 00000100:00100000:0.0:1789264352.087344:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789264352.087351:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322837376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264352.087393:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322837376:12345-0@lo:400:kworker.0 Request processed in 42us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264352.087401:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789264352.087416:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789264352.087422:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322838144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264352.087446:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322838144:12345-0@lo:400:kworker.0 Request processed in 26us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264352.087871:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322836992 00000100:00100000:1.0:1789264352.087877:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322836992 00000100:00100000:1.0:1789264352.087902:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322837504 00000100:00100000:1.0:1789264352.087905:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322837504 00000100:00100000:1.0:1789264352.087933:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789264352.087941:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322836992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264352.087950:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789264352.087966:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17947:x1876179322838912:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789264352.087986:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322836992:12345-0@lo:400:kworker.0 Request processed in 45us (6274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264352.087994:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789264352.088009:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789264352.088016:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322837504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264352.088045:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322837504:12345-0@lo:400:kworker.0 Request processed in 30us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264352.088051:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789264352.088102:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:2.0:1789264352.089526:0:17184:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789264352.092713:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789264352.092735:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322838272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264352.092841:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322838272:12345-0@lo:400:kworker.0 Request processed in 116us (5723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264352.092849:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1789264352.093217:0:17946:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:0.0:1789264352.093331:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983f48000 x1876179322838272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264352.093347:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322838272:0@lo:400:kworker.0 00000004:00080000:1.0:1789264352.093349:0:17946:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 432434604111ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789264352.093358:0:17946:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789264352.093377:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322839040:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1789264352.093402:0:17230:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1789264352.093420:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264352.093423:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17230:1876179322839296:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789264352.093458:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264352.093470:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52600 going to sleep for 11 seconds 00000100:00100000:1.0:1789264352.093516:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322838784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789264352.093541:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789264352.093568:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983f53100 x1876179322837376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264352.093591:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322837376:0@lo:400:kworker.0 00010000:00080000:1.0:1789264352.093603:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983f49f80 x1876179322838144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264352.093611:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322838144:0@lo:400:kworker.0 00000100:00100000:1.0:1789264352.093719:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322837504:0@lo:400:kworker.0 00000100:00100000:1.0:1789264352.094003:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322838784 00000100:00100000:1.0:1789264352.094010:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322838784 00000100:00100000:1.0:1789264352.094052:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789264352.094060:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3624:x1876179322838784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789264352.094083:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789264352.094096:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789264352.094105:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1789264352.094133:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3624:x1876179322838784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264352.094146:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789264352.094195:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3a8f349180 x1876179322838784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264352.094212:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322838784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789264352.094428:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322839040 00000100:00100000:1.0:1789264352.094433:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322839040 00000100:00100000:1.0:1789264352.094457:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789264352.094462:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322839296 00000100:00100000:1.0:1789264352.094464:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322839296 00000100:00100000:1.0:1789264352.094534:0:19869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789264352.094542:0:19869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3625:x1876179322839040:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1789264352.094806:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789264352.094819:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789264352.094823:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789264352.094826:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264352.094833:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322838528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789264352.094876:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264352.094916:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322836992:0@lo:400:kworker.0 00000100:00100000:0.0:1789264352.094928:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322837120:0@lo:400:kworker.0 00000100:00100000:0.0:1789264352.094943:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789264352.094949:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322839168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789264352.094969:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264352.095000:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322838528 00000100:00100000:0.0:1789264352.095004:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322838528 00000100:00100000:0.0:1789264352.095585:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322839168 00000100:00100000:0.0:1789264352.095590:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322839168 00000100:00100000:0.0:1789264352.095611:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789264352.095694:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3623:x1876179322838528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789264352.095716:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789264352.096303:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3623:x1876179322838528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 684us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264352.096311:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789264352.096333:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789264352.096340:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3623:x1876179322839168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789264352.096351:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789264352.096383:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3623:x1876179322839168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264352.096390:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789264352.096428:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983f4a680 x1876179322839168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789264368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264352.096448:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322839168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789264352.097185:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322838528:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1789264352.098400:0:17936:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000004:00080000:2.0:1789264352.099609:0:17936:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:1.0:1789264352.099847:0:19101:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789264352.099854:0:19101:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789264352.100058:0:19101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17945:x1876179322838656:12345-0@lo:7:osp-pre-0-1.0 Request processed in 14136us (14666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264352.100069:0:19101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789264352.100100:0:19101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789264352.100112:0:19101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:17230:x1876179322839296:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789264352.100251:0:17945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17945:1876179322838656:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1789264352.100270:0:17945:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789264352.100304:0:17945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f49f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17945:1876179322839424:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789264352.100350:0:17945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264352.100380:0:17945:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c52cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264352.100451:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:0.0:1789264352.100461:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00100000:3.0:1789264352.100987:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322839424 00000100:00100000:3.0:1789264352.100994:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322839424 00000100:00100000:3.0:1789264352.101277:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789264352.101287:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17945:x1876179322839424:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789264352.101307:0:18711:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789264352.101828:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17945:x1876179322839424:12345-0@lo:5:osp-pre-0-1.0 Request processed in 540us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264352.101896:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00002000:00080000:3.0:1789264352.101922:0:18709:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789264352.101927:0:18709:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789264352.101970:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17947:x1876179322838912:12345-0@lo:7:osp-pre-1-1.0 Request processed in 14007us (15622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264352.101978:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789264352.102261:0:17945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f49f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17945:1876179322839424:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789264352.102275:0:17945:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789264352.102317:0:17945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17945:1876179322839552:0@lo:5:osp-pre-0-1.0 00010000:00080000:2.0:1789264352.102352:0:17947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3a8f34b100 x1876179322838912/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789264368 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264352.102364:0:17947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f34b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17947:1876179322838912:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1789264352.102374:0:17947:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789264352.102397:0:17947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f34b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17947:1876179322839680:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789264352.102490:0:17945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264352.102513:0:17945:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa98b76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789264352.103151:0:19872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322839552 00000100:00100000:1.0:1789264352.103164:0:19872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322839552 00000100:00100000:1.0:1789264352.103201:0:19872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789264352.103210:0:19872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:17945:x1876179322839552:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789264352.103243:0:19872:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1789264352.107538:0:17947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264352.107785:0:17947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a852dccc0 going to sleep for 11 seconds 00000001:00080000:1.0:1789264352.107992:0:19526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789264352.108002:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789264352.108008:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00080000:2.0:1789264352.108482:0:19101:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789264352.108490:0:19101:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789264352.108496:0:19101:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000100:00100000:0.0:1789264352.110154:0:19869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3625:x1876179322839040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 15604us (16726us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789264352.110167:0:19869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789264352.110195:0:19869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322839680 00000100:00100000:0.0:1789264352.110202:0:19869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322839680 00010000:00080000:1.0:1789264352.110347:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3a8f34a680 x1876179322839040/t0(0) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789264368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789264352.110359:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c3a8f34a680, transno 8589934593 00000100:00100000:1.0:1789264352.110370:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000004:00080000:1.0:1789264352.110376:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c3a8f34a680/2, rc 0, transno 8589934593 00000100:00100000:1.0:1789264352.110382:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322839040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789264352.116989:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789264352.117009:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17947:x1876179322839680:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789264352.117044:0:18711:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789264352.117129:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17947:x1876179322839680:12345-0@lo:5:osp-pre-1-1.0 Request processed in 128us (9596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264352.117137:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000040:00080000:3.0:1789264352.117935:0:17229:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 1, last_idx 2 00000040:00080000:3.0:1789264352.117958:0:17229:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00010000:00080000:3.0:1789264352.119850:0:17947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3a8f34b100 x1876179322839680/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789264368 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264352.119869:0:17947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f34b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17947:1876179322839680:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789264352.119885:0:17947:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789264352.119941:0:17947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17947:1876179322839808:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789264352.119993:0:17947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264352.120030:0:17947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa1b5780 going to sleep for 11 seconds 00000100:00100000:0.0:1789264352.120082:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322839808 00000100:00100000:0.0:1789264352.120089:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322839808 00000100:00100000:0.0:1789264352.120163:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789264352.120172:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17947:x1876179322839808:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789264352.120207:0:18710:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1789264352.132850:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.132863:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9f0beca/0xecaf9f2f14ed811e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.132880:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.132885:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.132892:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9f0beca/0xecaf9f2f14ed811e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.132910:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9f0beca/0xecaf9f2f14ed811e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.132920:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9f0beca/0xecaf9f2f14ed811e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.132928:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9f0beca/0xecaf9f2f14ed811e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.132954:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789264352.134684:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.134695:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2f719b1/0xecaf9f2f14ed8125 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.134709:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.134720:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.134727:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2f719b1/0xecaf9f2f14ed8125 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.134739:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2f719b1/0xecaf9f2f14ed8125 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.134769:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2f719b1/0xecaf9f2f14ed8125 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.134777:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2f719b1/0xecaf9f2f14ed8125 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.134797:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789264352.135100:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789264352.135108:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9f0beca/0xecaf9f2f14ed811e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.135128:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36ba00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.135132:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9f0beca/0xecaf9f2f14ed811e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.135139:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9f0beca/0xecaf9f2f14ed811e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.135159:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9f0beca/0xecaf9f2f14ed811e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.135166:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9f0beca/0xecaf9f2f14ed811e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.135184:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264352.135188:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2f719b1/0xecaf9f2f14ed8125 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.135194:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a200 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.135197:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2f719b1/0xecaf9f2f14ed8125 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.135205:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2f719b1/0xecaf9f2f14ed8125 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.135214:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2f719b1/0xecaf9f2f14ed8125 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.135227:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2f719b1/0xecaf9f2f14ed8125 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.135240:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.135241:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.135243:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789264352.136057:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.136147:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4eefe2a/0xecaf9f2f14ed812c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.136289:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.136293:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.136308:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4eefe2a/0xecaf9f2f14ed812c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.136320:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4eefe2a/0xecaf9f2f14ed812c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.136329:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4eefe2a/0xecaf9f2f14ed812c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.136342:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4eefe2a/0xecaf9f2f14ed812c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.136364:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789264352.136448:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264352.136454:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4eefe2a/0xecaf9f2f14ed812c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.136461:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36a600 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.136469:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4eefe2a/0xecaf9f2f14ed812c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.136477:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4eefe2a/0xecaf9f2f14ed812c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.136491:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4eefe2a/0xecaf9f2f14ed812c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.136501:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4eefe2a/0xecaf9f2f14ed812c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.136517:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.136519:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.136521:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789264352.137118:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.137124:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccc83e2/0xecaf9f2f14ed8133 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.137135:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.137138:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.137143:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ccc83e2/0xecaf9f2f14ed8133 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.137152:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ccc83e2/0xecaf9f2f14ed8133 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.137159:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccc83e2/0xecaf9f2f14ed8133 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.137167:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ccc83e2/0xecaf9f2f14ed8133 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.137182:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789264352.137478:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789264352.137485:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ccc83e2/0xecaf9f2f14ed8133 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.137499:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b600 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:0.0:1789264352.137503:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccc83e2/0xecaf9f2f14ed8133 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.137508:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264352.137511:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccc83e2/0xecaf9f2f14ed8133 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.137535:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ccc83e2/0xecaf9f2f14ed8133 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.137543:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ccc83e2/0xecaf9f2f14ed8133 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.137561:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264352.137563:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264352.137565:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789264352.139509:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.139519:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005be6229b/0xecaf9f2f14ed813a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.139541:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.139546:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.139552:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005be6229b/0xecaf9f2f14ed813a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.139565:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005be6229b/0xecaf9f2f14ed813a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.139575:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005be6229b/0xecaf9f2f14ed813a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.139583:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005be6229b/0xecaf9f2f14ed813a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.139599:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789264352.139952:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.139958:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8141 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.139966:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.139970:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.139973:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8141 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.139982:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8141 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.139999:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8141 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.140005:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8141 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.140019:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789264352.140234:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.140241:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8148 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.140250:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.140253:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.140257:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8148 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.140641:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8148 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.140650:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8148 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.140658:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8148 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.140688:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789264352.141124:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.141131:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0d00/0xecaf9f2f14ed814f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.141141:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.141145:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.141150:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0d00/0xecaf9f2f14ed814f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.141159:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0d00/0xecaf9f2f14ed814f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.141168:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0d00/0xecaf9f2f14ed814f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.141175:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0d00/0xecaf9f2f14ed814f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.141183:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789264352.141876:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789264352.141885:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005be6229b/0xecaf9f2f14ed813a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.141896:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36be00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.141901:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005be6229b/0xecaf9f2f14ed813a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.141909:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005be6229b/0xecaf9f2f14ed813a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.141930:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005be6229b/0xecaf9f2f14ed813a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.141937:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005be6229b/0xecaf9f2f14ed813a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.141957:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789264352.141961:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8141 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.141968:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36aa00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.141971:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8141 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.141979:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8141 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.141998:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8141 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.142005:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f909c2b/0xecaf9f2f14ed8141 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.142018:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789264352.142022:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8148 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.142028:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36bc00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.142032:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8148 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.142039:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8148 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.142049:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8148 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.142056:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b30eeca3/0xecaf9f2f14ed8148 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.142069:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264352.142072:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0d00/0xecaf9f2f14ed814f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.142084:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36b400 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.142087:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0d00/0xecaf9f2f14ed814f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.142095:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0d00/0xecaf9f2f14ed814f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.142104:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0d00/0xecaf9f2f14ed814f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.142111:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0d00/0xecaf9f2f14ed814f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.142124:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.142126:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.142128:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.142135:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789264352.142500:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.142508:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed8156 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.142519:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.142528:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.142534:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed8156 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.142545:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed8156 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.142553:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed8156 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.142561:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed8156 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.142577:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789264352.142714:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264352.142720:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed8156 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.142727:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a8a36ac00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264352.142730:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed8156 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.142738:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed8156 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.142781:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed8156 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.142800:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bad8f754/0xecaf9f2f14ed8156 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.142814:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264352.142816:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264352.142817:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789264352.143245:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.143251:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036ef0977/0xecaf9f2f14ed815d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.143380:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.143384:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.143389:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036ef0977/0xecaf9f2f14ed815d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.143400:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036ef0977/0xecaf9f2f14ed815d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.143407:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036ef0977/0xecaf9f2f14ed815d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.143414:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036ef0977/0xecaf9f2f14ed815d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.143429:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789264352.143997:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.144010:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003360ead4/0xecaf9f2f14ed8164 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144021:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.144025:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.144030:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003360ead4/0xecaf9f2f14ed8164 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144040:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003360ead4/0xecaf9f2f14ed8164 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144049:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003360ead4/0xecaf9f2f14ed8164 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144056:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003360ead4/0xecaf9f2f14ed8164 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144070:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789264352.144176:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789264352.144184:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036ef0977/0xecaf9f2f14ed815d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144192:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836caa00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264352.144197:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036ef0977/0xecaf9f2f14ed815d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144206:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036ef0977/0xecaf9f2f14ed815d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144231:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036ef0977/0xecaf9f2f14ed815d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144239:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036ef0977/0xecaf9f2f14ed815d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144257:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264352.144260:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003360ead4/0xecaf9f2f14ed8164 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144275:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836ca600 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264352.144279:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003360ead4/0xecaf9f2f14ed8164 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144287:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003360ead4/0xecaf9f2f14ed8164 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144298:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003360ead4/0xecaf9f2f14ed8164 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144305:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003360ead4/0xecaf9f2f14ed8164 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.144319:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264352.144321:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264352.145413:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789264352.145483:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.145491:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a87803b/0xecaf9f2f14ed816b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.145504:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.145509:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.145514:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a87803b/0xecaf9f2f14ed816b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.145527:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a87803b/0xecaf9f2f14ed816b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.145536:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a87803b/0xecaf9f2f14ed816b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.145543:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a87803b/0xecaf9f2f14ed816b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.145558:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789264352.145706:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264352.145712:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a87803b/0xecaf9f2f14ed816b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.145721:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cb000 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264352.145724:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a87803b/0xecaf9f2f14ed816b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.145762:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a87803b/0xecaf9f2f14ed816b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.145777:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a87803b/0xecaf9f2f14ed816b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.145785:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a87803b/0xecaf9f2f14ed816b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.145800:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264352.145802:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264352.145803:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.146132:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.146139:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789264352.147245:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.147255:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b93024/0xecaf9f2f14ed8172 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.147419:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.147423:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.147430:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b93024/0xecaf9f2f14ed8172 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.147443:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076b93024/0xecaf9f2f14ed8172 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.147451:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b93024/0xecaf9f2f14ed8172 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.147464:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076b93024/0xecaf9f2f14ed8172 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.147480:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789264352.147988:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.147996:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8179 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.148007:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.148010:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.148015:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8179 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.148026:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8179 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.148034:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8179 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.148041:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8179 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.148059:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789264352.148471:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789264352.148480:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076b93024/0xecaf9f2f14ed8172 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.148490:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836ca200 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.148494:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b93024/0xecaf9f2f14ed8172 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.148515:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b93024/0xecaf9f2f14ed8172 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.148532:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076b93024/0xecaf9f2f14ed8172 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.148540:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076b93024/0xecaf9f2f14ed8172 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.148556:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264352.148559:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8179 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.148566:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cae00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.148569:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8179 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.148578:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8179 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.148588:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8179 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.148595:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ca0d752/0xecaf9f2f14ed8179 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.148619:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.148621:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.148623:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264352.148904:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789264352.148968:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.148975:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000645edddd/0xecaf9f2f14ed8180 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.148990:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.148993:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.148999:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000645edddd/0xecaf9f2f14ed8180 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.149009:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000645edddd/0xecaf9f2f14ed8180 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.149018:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000645edddd/0xecaf9f2f14ed8180 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.149024:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000645edddd/0xecaf9f2f14ed8180 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.149048:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264352.149082:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264352.149090:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000645edddd/0xecaf9f2f14ed8180 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.149099:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fc000 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264352.149103:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000645edddd/0xecaf9f2f14ed8180 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.149112:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000645edddd/0xecaf9f2f14ed8180 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.149128:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000645edddd/0xecaf9f2f14ed8180 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.149135:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000645edddd/0xecaf9f2f14ed8180 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.149169:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264352.149171:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264352.149173:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789264352.150500:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.150509:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005495310e/0xecaf9f2f14ed8187 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.150523:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.150527:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.150532:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005495310e/0xecaf9f2f14ed8187 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.150543:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005495310e/0xecaf9f2f14ed8187 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.150561:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005495310e/0xecaf9f2f14ed8187 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.150568:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005495310e/0xecaf9f2f14ed8187 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.150585:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789264352.150769:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264352.150777:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005495310e/0xecaf9f2f14ed8187 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.150785:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fcc00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.150789:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005495310e/0xecaf9f2f14ed8187 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.150798:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005495310e/0xecaf9f2f14ed8187 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.150815:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005495310e/0xecaf9f2f14ed8187 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.151078:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005495310e/0xecaf9f2f14ed8187 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.151102:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.151104:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.151105:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789264352.151775:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789264352.151782:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f9bdd79/0xecaf9f2f14ed818e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.151794:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789264352.151797:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789264352.151803:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f9bdd79/0xecaf9f2f14ed818e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.151814:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f9bdd79/0xecaf9f2f14ed818e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789264352.152333:0:18706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789264352.152345:0:18706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1789264352.152401:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f9bdd79/0xecaf9f2f14ed818e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.152413:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f9bdd79/0xecaf9f2f14ed818e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.152486:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789264352.153544:0:19872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:17945:x1876179322839552:12345-0@lo:5:osp-pre-0-1.0 Request processed in 50329us (51048us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789264352.153554:0:19872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789264352.153733:0:17945:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789264352.153756:0:17945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17945:1876179322839552:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789264352.153772:0:17945:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1789264352.153833:0:17945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17945:1876179322839936:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789264352.153868:0:17945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264352.153893:0:17945:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae144300 going to sleep for 11 seconds 00000100:00100000:3.0:1789264352.154351:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322839936 00000100:00100000:3.0:1789264352.154359:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322839936 00000100:00100000:3.0:1789264352.154395:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789264352.154403:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17945:x1876179322839936:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789264352.154452:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17945:x1876179322839936:12345-0@lo:900:osp-pre-0-1.0 Request processed in 49us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264352.154458:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789264352.154576:0:17945:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c39847a6a00 x1876179322839936/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789264368 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789264352.154588:0:17945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39847a6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17945:1876179322839936:0@lo:900:osp-pre-0-1.0 00002000:00010000:0.0:1789264352.154769:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264352.154777:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014b69873/0xecaf9f2f14ed8195 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.154798:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789264352.154802:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264352.154809:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014b69873/0xecaf9f2f14ed8195 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.155071:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014b69873/0xecaf9f2f14ed8195 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.155083:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014b69873/0xecaf9f2f14ed8195 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.155090:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014b69873/0xecaf9f2f14ed8195 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.156383:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789264352.156395:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f9bdd79/0xecaf9f2f14ed818e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.156406:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fc400 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264352.156411:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f9bdd79/0xecaf9f2f14ed818e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.156421:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f9bdd79/0xecaf9f2f14ed818e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.156441:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f9bdd79/0xecaf9f2f14ed818e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.156448:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f9bdd79/0xecaf9f2f14ed818e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.156466:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264352.156470:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014b69873/0xecaf9f2f14ed8195 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.156476:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ba00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264352.156479:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014b69873/0xecaf9f2f14ed8195 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.156487:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014b69873/0xecaf9f2f14ed8195 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.156511:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014b69873/0xecaf9f2f14ed8195 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.156519:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264352.156521:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264352.156523:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264352.159202:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789264352.159215:0:19101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014b69873/0xecaf9f2f14ed8195 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789264352.159612:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264352.159619:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000748f675e/0xecaf9f2f14ed819c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.159633:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789264352.159637:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264352.159643:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748f675e/0xecaf9f2f14ed819c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.159666:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000748f675e/0xecaf9f2f14ed819c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.159688:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000748f675e/0xecaf9f2f14ed819c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.159696:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000748f675e/0xecaf9f2f14ed819c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.159978:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264352.159987:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000748f675e/0xecaf9f2f14ed819c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.159996:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b800 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264352.159999:0:18738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000748f675e/0xecaf9f2f14ed819c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.160007:0:18738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000748f675e/0xecaf9f2f14ed819c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.160024:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000748f675e/0xecaf9f2f14ed819c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264352.160033:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264352.160035:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264352.160037:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264352.160133:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789264352.160138:0:19101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000748f675e/0xecaf9f2f14ed819c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789264352.162554:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264352.162564:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6aac93c/0xecaf9f2f14ed81a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.162580:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789264352.162584:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264352.162591:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6aac93c/0xecaf9f2f14ed81a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.162605:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6aac93c/0xecaf9f2f14ed81a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.162626:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6aac93c/0xecaf9f2f14ed81a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.162633:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6aac93c/0xecaf9f2f14ed81a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.163439:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264352.163447:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6aac93c/0xecaf9f2f14ed81a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.163469:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366be00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.163474:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6aac93c/0xecaf9f2f14ed81a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.163483:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6aac93c/0xecaf9f2f14ed81a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.163500:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6aac93c/0xecaf9f2f14ed81a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.163510:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.163512:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.163513:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264352.163620:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789264352.163626:0:19101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6aac93c/0xecaf9f2f14ed81a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789264352.164017:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264352.164023:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006409edf9/0xecaf9f2f14ed81aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164034:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789264352.164038:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264352.164044:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006409edf9/0xecaf9f2f14ed81aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164054:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006409edf9/0xecaf9f2f14ed81aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164063:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006409edf9/0xecaf9f2f14ed81aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164083:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006409edf9/0xecaf9f2f14ed81aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164102:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789264352.164245:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264352.164253:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006409edf9/0xecaf9f2f14ed81aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.164261:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b400 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264352.164265:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006409edf9/0xecaf9f2f14ed81aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.164273:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006409edf9/0xecaf9f2f14ed81aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.164286:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006409edf9/0xecaf9f2f14ed81aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.164293:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006409edf9/0xecaf9f2f14ed81aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.164307:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264352.164309:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264352.164310:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789264352.164360:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264352.164367:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cc8419d/0xecaf9f2f14ed81b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164376:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789264352.164379:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264352.164384:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cc8419d/0xecaf9f2f14ed81b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164394:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cc8419d/0xecaf9f2f14ed81b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164402:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cc8419d/0xecaf9f2f14ed81b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164410:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cc8419d/0xecaf9f2f14ed81b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164426:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789264352.164655:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264352.164661:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eada1589/0xecaf9f2f14ed81b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164687:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789264352.164690:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264352.164695:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eada1589/0xecaf9f2f14ed81b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164704:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eada1589/0xecaf9f2f14ed81b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164712:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eada1589/0xecaf9f2f14ed81b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164719:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eada1589/0xecaf9f2f14ed81b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.164739:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789264352.164986:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789264352.164992:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cc8419d/0xecaf9f2f14ed81b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.165000:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366a000 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264352.165004:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cc8419d/0xecaf9f2f14ed81b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.165012:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cc8419d/0xecaf9f2f14ed81b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.165025:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cc8419d/0xecaf9f2f14ed81b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.165031:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cc8419d/0xecaf9f2f14ed81b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.165050:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789264352.165054:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eada1589/0xecaf9f2f14ed81b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.165061:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ae00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264352.165064:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eada1589/0xecaf9f2f14ed81b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.165072:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eada1589/0xecaf9f2f14ed81b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.165108:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eada1589/0xecaf9f2f14ed81b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.165115:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eada1589/0xecaf9f2f14ed81b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264352.165143:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264352.165146:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789264352.165150:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.165164:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264352.165427:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789264352.166089:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264352.166098:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed81bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.166111:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789264352.166115:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264352.166120:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed81bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.166131:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed81bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.166153:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed81bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.166160:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed81bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.166175:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789264352.166480:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264352.166487:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed81c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.166495:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789264352.166499:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264352.166502:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed81c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.166512:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed81c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.166521:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed81c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.166529:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed81c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.166687:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789264352.167126:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264352.167134:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87d4866/0xecaf9f2f14ed81cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.167144:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789264352.167148:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264352.167153:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87d4866/0xecaf9f2f14ed81cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.167163:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f87d4866/0xecaf9f2f14ed81cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.167172:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87d4866/0xecaf9f2f14ed81cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.167180:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f87d4866/0xecaf9f2f14ed81cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167239:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789264352.167247:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed81bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167255:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366bc00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.167259:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed81bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167279:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed81bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167296:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed81bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167311:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed81bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167335:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789264352.167339:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed81c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167346:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b000 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.167350:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed81c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167358:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed81c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167370:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed81c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167378:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e52beae/0xecaf9f2f14ed81c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167392:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264352.167396:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f87d4866/0xecaf9f2f14ed81cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167402:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366ac00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.167411:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87d4866/0xecaf9f2f14ed81cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167419:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87d4866/0xecaf9f2f14ed81cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167430:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f87d4866/0xecaf9f2f14ed81cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.167439:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.167441:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.167444:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264352.167525:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264352.167585:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789264352.167591:0:19101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f87d4866/0xecaf9f2f14ed81cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264352.167792:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17947:x1876179322839808:12345-0@lo:5:osp-pre-1-1.0 Request processed in 47617us (47794us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789264352.167803:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789264352.167953:0:17947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17947:1876179322839808:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789264352.167969:0:17947:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789264352.168008:0:17947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f49180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17947:1876179322840064:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789264352.168047:0:17947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264352.168074:0:17947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aaa1b5780 going to sleep for 11 seconds 00000100:00100000:1.0:1789264352.168098:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322840064 00000100:00100000:1.0:1789264352.168104:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322840064 00000100:00100000:1.0:1789264352.168149:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789264352.168151:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264352.168159:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17947:x1876179322840064:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789264352.168219:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17947:x1876179322840064:12345-0@lo:900:osp-pre-1-1.0 Request processed in 61us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264352.168227:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:0.0:1789264352.168306:0:19101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789264352.168313:0:19101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc92db33/0xecaf9f2f14ed81d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.168331:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789264352.168335:0:19101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264352.168340:0:19101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc92db33/0xecaf9f2f14ed81d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1789264352.168343:0:17947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983f49180 x1876179322840064/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789264368 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264352.168354:0:17947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f49180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17947:1876179322840064:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1789264352.168422:0:19101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc92db33/0xecaf9f2f14ed81d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.168428:0:19101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc92db33/0xecaf9f2f14ed81d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.168433:0:19101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc92db33/0xecaf9f2f14ed81d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264352.168447:0:19101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789264352.168476:0:19101:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1789264352.168525:0:19101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17230:x1876179322839296:12345-0@lo:5:osp-pre-1-0.0 Request processed in 68417us (75064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264352.168533:0:19101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789264352.168558:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264352.168564:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc92db33/0xecaf9f2f14ed81d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.168578:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366a800 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264352.168582:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc92db33/0xecaf9f2f14ed81d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.168589:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc92db33/0xecaf9f2f14ed81d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264352.168592:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17230:1876179322839296:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789264352.168602:0:17230:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00010000:00010000:1.0:1789264352.168602:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc92db33/0xecaf9f2f14ed81d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.168609:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc92db33/0xecaf9f2f14ed81d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264352.168622:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264352.168624:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264352.168626:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17230:1876179322840192:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1789264352.168626:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264352.168653:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264352.168700:0:19869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322840192 00000100:00100000:0.0:1789264352.168704:0:19869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322840192 00000100:00100000:3.0:1789264352.168706:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a964900 going to sleep for 11 seconds 00000100:00100000:0.0:1789264352.168731:0:19869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789264352.168738:0:19869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17230:x1876179322840192:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789264352.168891:0:19869:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1789264352.171704:0:19869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17230:x1876179322840192:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2959us (3043us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789264352.171724:0:19869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789264352.172004:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17230:1876179322840192:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789264352.172019:0:17230:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000001:02000400:0.0:1789264352.195067:0:19883:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789264352.778340:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789264352.778362:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322840320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789264352.778425:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264352.780733:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322840320 00000100:00100000:2.0:1789264352.781092:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322840320 00000100:00100000:2.0:1789264352.781154:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789264352.781164:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322840320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789264352.781186:0:18712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789264352.781258:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322840320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264352.781265:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789264352.781320:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322840320:0@lo:13:osp-pre-0-0.0 00000020:00000004:2.0:1789264352.797216:0:19935:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789264352.797404:0:19935:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789264353.162562:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789264353.527580:0:19985:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789264353.528088:0:19985:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789264353.769805:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264353.769913:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311245696 00000100:00100000:2.0:1789264353.769922:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311245696 00000100:00100000:2.0:1789264353.769972:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 112 00000100:00100000:2.0:1789264353.769995:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1876179311245696:12345-192.168.203.44@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789264353.770023:0:17199:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c15e3cda-8a20-42cd-8b8c-4b2123105b47@192.168.203.44@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:2.0:1789264353.770050:0:17199:0:(genops.c:1385:class_connect()) connect: client c15e3cda-8a20-42cd-8b8c-4b2123105b47, cookie 0xecaf9f2f14ed81db 00000100:00080000:2.0:1789264353.770187:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9c3abaf0e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789264353.770279:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+5:2401:x1876179311245696:12345-192.168.203.44@tcp:250:mount.lustre.0 Request processed in 283us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264353.770286:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 112 00000100:00100000:3.0:1789264353.781686:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264353.783255:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311245824 00000100:00100000:0.0:1789264353.783271:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311245824 00000100:00100000:0.0:1789264353.783355:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 113 00000100:00100000:0.0:1789264353.783366:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+5:14881:x1876179311245824:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789264353.783382:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264353.783398:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c398366a600/0xecaf9f2f14ed81e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae5e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264353.783528:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c398366a600/0xecaf9f2f14ed81e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae5e expref: 6 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264353.783540:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c398366a600/0xecaf9f2f14ed81e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae5e expref: 6 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264353.783549:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366a600, rc 0) 00000100:00100000:0.0:1789264353.784765:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+6:14881:x1876179311245824:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 1394us (3096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264353.784775:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 113 00000100:00100000:3.0:1789264353.791607:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264353.791735:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311245952 00000100:00100000:1.0:1789264353.791782:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311245952 00000100:00100000:1.0:1789264353.791935:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 114 00000100:00100000:1.0:1789264353.791959:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+6:14881:x1876179311245952:12345-192.168.203.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789264353.792096:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+6:14881:x1876179311245952:12345-192.168.203.44@tcp:501:mount.lustre.0 Request processed in 139us (504us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789264353.792104:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 114 00000100:00100000:1.0:1789264353.798287:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264353.798400:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311246080 00000100:00100000:0.0:1789264353.798409:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311246080 00000100:00100000:0.0:1789264353.798482:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 115 00000100:00100000:0.0:1789264353.798492:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+6:14881:x1876179311246080:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789264353.798510:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264353.798527:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c398366b600/0xecaf9f2f14ed81e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae65 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264353.798571:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c398366b600/0xecaf9f2f14ed81e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae65 expref: 7 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264353.798584:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c398366b600/0xecaf9f2f14ed81e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae65 expref: 7 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264353.798594:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366b600, rc 0) 00000100:00100000:0.0:1789264353.798657:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+7:14881:x1876179311246080:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 167us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264353.798673:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 115 00000100:00100000:1.0:1789264353.802336:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322840448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789264353.802404:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264353.802550:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322840448 00000100:00100000:2.0:1789264353.802557:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322840448 00000100:00100000:2.0:1789264353.802610:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789264353.802619:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322840448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789264353.802651:0:17208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789264353.802711:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322840448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264353.802718:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789264353.802783:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8f348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322840448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789264353.806121:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322840576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789264353.806233:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264353.806394:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322840576 00000100:00100000:2.0:1789264353.806408:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322840576 00000100:00100000:2.0:1789264353.806490:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789264353.806501:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322840576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789264353.806539:0:17208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789264353.810619:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322840576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4112us (4377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264353.810633:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789264353.811866:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322840576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789264353.811971:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264353.812479:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311246208 00000100:00100000:1.0:1789264353.812489:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311246208 00000100:00100000:1.0:1789264353.812557:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 116 00000100:00100000:1.0:1789264353.812569:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+7:14881:x1876179311246208:12345-192.168.203.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789264353.812910:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+8:14881:x1876179311246208:12345-192.168.203.44@tcp:501:mount.lustre.0 Request processed in 342us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264353.812920:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 116 00000100:00100000:1.0:1789264353.816315:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264353.817249:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311246336 00000100:00100000:2.0:1789264353.817280:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311246336 00000100:00100000:2.0:1789264353.817374:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 117 00000100:00100000:2.0:1789264353.817383:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+8:14881:x1876179311246336:12345-192.168.203.44@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789264353.817568:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+8:14881:x1876179311246336:12345-192.168.203.44@tcp:503:mount.lustre.0 Request processed in 185us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264353.817577:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 117 00000100:00100000:2.0:1789264353.821613:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264353.822563:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311246464 00000100:00100000:1.0:1789264353.822577:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311246464 00000100:00100000:1.0:1789264353.822800:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 118 00000100:00100000:1.0:1789264353.822813:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+8:14900:x1876179311246464:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789264353.823041:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+8:14900:x1876179311246464:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 230us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264353.823050:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 118 00000100:00100000:3.0:1789264353.854249:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264353.854336:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311246592 00000100:00100000:2.0:1789264353.854349:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311246592 00000100:00100000:2.0:1789264353.854423:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 119 00000100:00100000:2.0:1789264353.854434:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+8:14900:x1876179311246592:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789264353.855071:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+8:14900:x1876179311246592:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 635us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264353.855081:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 119 00000100:00100000:3.0:1789264353.865496:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264353.865792:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311246720 00000100:00100000:1.0:1789264353.865805:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311246720 00000100:00100000:1.0:1789264353.865984:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 120 00000100:00100000:1.0:1789264353.866014:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+8:14900:x1876179311246720:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789264353.866211:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+8:14900:x1876179311246720:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 200us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264353.866222:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 120 00000100:00100000:1.0:1789264353.870392:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264353.870498:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311246848 00000100:00100000:2.0:1789264353.870509:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311246848 00000100:00100000:2.0:1789264353.870617:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 121 00000100:00100000:2.0:1789264353.871240:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+8:14881:x1876179311246848:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789264353.871269:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264353.871293:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3abac1da00/0xecaf9f2f14ed81f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae96 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264353.871329:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3abac1da00/0xecaf9f2f14ed81f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae96 expref: 9 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264353.871341:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3abac1da00/0xecaf9f2f14ed81f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae96 expref: 9 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264353.871372:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1da00, rc 0) 00000100:00100000:2.0:1789264353.871445:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+9:14881:x1876179311246848:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 818us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264353.871452:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 121 00000100:00100000:2.0:1789264353.878812:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264353.878918:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311246976 00000100:00100000:1.0:1789264353.878931:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311246976 00000100:00100000:1.0:1789264353.879064:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 122 00000100:00100000:1.0:1789264353.879075:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+9:14881:x1876179311246976:12345-192.168.203.44@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789264353.879108:0:17198:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789264353.879139:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789264353.879144:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789264353.879148:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789264353.879151:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789264353.879154:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789264353.884832:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+9:14881:x1876179311246976:12345-192.168.203.44@tcp:256:mount.lustre.0 Request processed in 5742us (6017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264353.884850:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 122 00000100:00100000:2.0:1789264353.891419:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264353.891527:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311247104 00000100:00100000:0.0:1789264353.891548:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311247104 00000100:00100000:2.0:1789264353.891931:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 123 00000100:00100000:2.0:1789264353.891948:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+9:14881:x1876179311247104:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789264353.891970:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264353.891994:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed81f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdae9d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264353.892031:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed81f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae9d expref: 10 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264353.892047:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed81f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae9d expref: 10 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264353.892057:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1d000, rc 0) 00000100:00100000:2.0:1789264353.892374:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+10:14881:x1876179311247104:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 430us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264353.892382:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 123 00000100:00100000:3.0:1789264353.895394:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264353.895865:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311247232 00000100:00100000:1.0:1789264353.895879:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311247232 00000100:00100000:1.0:1789264353.895988:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 124 00000100:00100000:1.0:1789264353.896001:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+10:14881:x1876179311247232:12345-192.168.203.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789264353.896235:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+10:14881:x1876179311247232:12345-192.168.203.44@tcp:501:mount.lustre.0 Request processed in 236us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264353.896243:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 124 00000100:00100000:3.0:1789264353.900246:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264353.900422:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311247360 00000100:00100000:2.0:1789264353.900435:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311247360 00000100:00100000:2.0:1789264353.900510:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 125 00000100:00100000:2.0:1789264353.900522:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+10:14881:x1876179311247360:12345-192.168.203.44@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789264353.900735:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+10:14881:x1876179311247360:12345-192.168.203.44@tcp:503:mount.lustre.0 Request processed in 215us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264353.900789:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 125 00000100:00100000:2.0:1789264353.909869:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264353.910840:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311247488 00000100:00100000:1.0:1789264353.910875:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311247488 00000100:00100000:1.0:1789264353.911003:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 126 00000100:00100000:1.0:1789264353.911017:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+10:14905:x1876179311247488:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789264353.911739:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+10:14905:x1876179311247488:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 720us (1877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264353.911991:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 126 00000100:00100000:3.0:1789264353.919649:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264353.919819:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311247616 00000100:00100000:2.0:1789264353.919832:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311247616 00000100:00100000:2.0:1789264353.919905:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 127 00000100:00100000:2.0:1789264353.919920:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abbfc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+10:14905:x1876179311247616:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789264353.920152:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abbfc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+10:14905:x1876179311247616:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 236us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264353.920162:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 127 00000100:00100000:3.0:1789264353.932310:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264353.933278:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264353.933884:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311247744 00000100:00100000:1.0:1789264353.933899:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311247744 00000100:00100000:2.0:1789264353.934042:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311248000 00000100:00100000:2.0:1789264353.934047:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311248000 00000100:00100000:2.0:1789264353.934129:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:2.0:1789264353.934139:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1876179311247744:12345-192.168.203.44@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789264353.934180:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from dd292616-4ff1-43bd-9855-5a9de2560302@192.168.203.44@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:2.0:1789264353.934247:0:17205:0:(genops.c:1385:class_connect()) connect: client dd292616-4ff1-43bd-9855-5a9de2560302, cookie 0xecaf9f2f14ed81fe 00000100:00100000:0.0:1789264353.934257:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:0.0:1789264353.934266:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1876179311248000:12345-192.168.203.44@tcp:38:mount.lustre.0 00000004:00100000:2.0:1789264353.934280:0:17205:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00010000:00080000:0.0:1789264353.934299:0:17204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from dd292616-4ff1-43bd-9855-5a9de2560302@192.168.203.44@tcp t0 exp 0000000000000000 cur 434 last 0 00000100:00080000:2.0:1789264353.934543:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9c3abaf09000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789264353.934638:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+6:2401:x1876179311247744:12345-192.168.203.44@tcp:38:mount.lustre.0 Request processed in 498us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264353.934646:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00000020:00000080:0.0:1789264353.934699:0:17204:0:(genops.c:1385:class_connect()) connect: client dd292616-4ff1-43bd-9855-5a9de2560302, cookie 0xecaf9f2f14ed8205 00000004:00100000:0.0:1789264353.934717:0:17204:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789264353.934977:0:17204:0:(import.c:65:import_set_state_nolock()) ffff9c3aaff13800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789264353.935009:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+6:2401:x1876179311248000:12345-192.168.203.44@tcp:38:mount.lustre.0 Request processed in 742us (1736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264353.935016:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:1.0:1789264353.944601:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264353.944699:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264353.944737:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311248128 00000100:00100000:3.0:1789264353.944777:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311248128 00000100:00100000:3.0:1789264353.944868:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311247872 00000100:00100000:3.0:1789264353.944871:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311247872 00000100:00100000:3.0:1789264353.944935:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:3.0:1789264353.944948:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+6:0:x1876179311248128:12345-192.168.203.44@tcp:41:mount.lustre.0 00000100:00100000:2.0:1789264353.944963:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:2.0:1789264353.944972:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+6:0:x1876179311247872:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789264353.944987:0:18643:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000004:00000024:2.0:1789264353.944993:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:1.0:1789264353.945091:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789264353.945097:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789264353.948800:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+6:0:x1876179311248128:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 3836us (4261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264353.948820:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:2.0:1789264353.949070:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+6:0:x1876179311247872:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 4097us (4370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264353.949080:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:0.0:1789264353.949293:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264353.949550:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311248256 00000100:00100000:3.0:1789264353.949562:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311248256 00000100:00100000:3.0:1789264353.949677:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:3.0:1789264353.949686:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+6:14881:x1876179311248256:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789264353.949724:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789264353.949800:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+6:14881:x1876179311248256:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 115us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264353.949807:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:1.0:1789264353.957086:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264353.957186:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311248384 00000100:00100000:3.0:1789264353.957201:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311248384 00000100:00100000:2.0:1789264353.959615:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:2.0:1789264353.959651:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+6:14881:x1876179311248384:12345-192.168.203.44@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789264353.960480:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+6:14881:x1876179311248384:12345-192.168.203.44@tcp:40:mount.lustre.0 Request processed in 844us (3403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264353.960493:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:1.0:1789264353.965800:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264353.965854:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264353.965897:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264353.965998:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311248768 00000100:00100000:2.0:1789264353.966011:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311248768 00000100:00100000:2.0:1789264353.966084:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:2.0:1789264353.966097:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd292616-4ff1-43bd-9855-5a9de2560302+6:14881:x1876179311248768:12345-192.168.203.44@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789264353.966198:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd292616-4ff1-43bd-9855-5a9de2560302+6:14881:x1876179311248768:12345-192.168.203.44@tcp:900:mount.lustre.0 Request processed in 103us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264353.966207:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:3.0:1789264353.966401:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311248512 00000100:00100000:3.0:1789264353.966406:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311248512 00000100:00100000:3.0:1789264353.966446:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311248640 00000100:00100000:3.0:1789264353.966449:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311248640 00000100:00100000:3.0:1789264353.966472:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:3.0:1789264353.966479:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1876179311248512:12345-192.168.203.44@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789264353.966508:0:18711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from dd292616-4ff1-43bd-9855-5a9de2560302@192.168.203.44@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:3.0:1789264353.966557:0:18711:0:(genops.c:1385:class_connect()) connect: client dd292616-4ff1-43bd-9855-5a9de2560302, cookie 0xecaf9f2f14ed820c 00002000:00100000:3.0:1789264353.966572:0:18711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dd292616-4ff1-43bd-9855-5a9de2560302/ffff9c39846ac000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789264353.966594:0:18711:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789264353.966891:0:18711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789264353.966926:0:18711:0:(import.c:65:import_set_state_nolock()) ffff9c39846aa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789264353.966974:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd292616-4ff1-43bd-9855-5a9de2560302+6:2401:x1876179311248512:12345-192.168.203.44@tcp:8:mount.lustre.0 Request processed in 494us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264353.966982:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:3.0:1789264353.967001:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:3.0:1789264353.967006:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1876179311248640:12345-192.168.203.44@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789264353.967026:0:18711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from dd292616-4ff1-43bd-9855-5a9de2560302@192.168.203.44@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:3.0:1789264353.967045:0:18711:0:(genops.c:1385:class_connect()) connect: client dd292616-4ff1-43bd-9855-5a9de2560302, cookie 0xecaf9f2f14ed8213 00002000:00100000:3.0:1789264353.967051:0:18711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dd292616-4ff1-43bd-9855-5a9de2560302/ffff9c39846af800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789264353.967064:0:18711:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789264353.967176:0:18711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789264353.967193:0:18711:0:(import.c:65:import_set_state_nolock()) ffff9c39846a8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789264353.967217:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd292616-4ff1-43bd-9855-5a9de2560302+6:2401:x1876179311248640:12345-192.168.203.44@tcp:8:mount.lustre.0 Request processed in 209us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264353.967223:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:1.0:1789264353.969975:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264353.970121:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311248896 00000100:00100000:3.0:1789264353.970133:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311248896 00000100:00100000:3.0:1789264353.970200:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:3.0:1789264353.970212:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd292616-4ff1-43bd-9855-5a9de2560302+6:14881:x1876179311248896:12345-192.168.203.44@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789264353.971542:0:17206:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1206us 00000004:00200000:1.0:1789264353.981336:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789264353.981517:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd292616-4ff1-43bd-9855-5a9de2560302+6:14881:x1876179311248896:12345-192.168.203.44@tcp:33:mount.lustre.0 Request processed in 11299us (11548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264353.981535:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:1.0:1789264354.169213:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264354.169369:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311249024 00000100:00100000:3.0:1789264354.169378:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311249024 00000100:00100000:3.0:1789264354.169447:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:3.0:1789264354.169457:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+6:14928:x1876179311249024:12345-192.168.203.44@tcp:101:mkdir.0 00010000:00010000:3.0:1789264354.169490:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264354.169514:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd200/0xecaf9f2f14ed821a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaece expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264354.169583:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed8221 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264354.169597:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed8221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264354.169624:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed8221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264354.169683:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789264354.169687:0:17203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264354.169721:0:17203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed8221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264354.169786:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd200/0xecaf9f2f14ed821a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaece expref: 8 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264354.169807:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed8221 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaece expref: 7 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264354.169830:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983361200) 00010000:00010000:3.0:1789264354.169832:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789264354.169835:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a813fd800, rc 0) 00000100:00100000:3.0:1789264354.169893:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+7:14928:x1876179311249024:12345-192.168.203.44@tcp:101:mkdir.0 Request processed in 438us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264354.169900:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 13 00010000:00010000:3.0:1789264354.186526:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264355.213727:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264355.995334:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264355.995507:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311249152 00000100:00100000:3.0:1789264355.995517:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311249152 00000100:00100000:3.0:1789264355.995666:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00100000:3.0:1789264355.995678:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+7:14981:x1876179311249152:12345-192.168.203.44@tcp:41:lfs.0 00000004:00000024:3.0:1789264355.995716:0:18643:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:1.0:1789264355.995719:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789264355.995873:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+7:14981:x1876179311249152:12345-192.168.203.44@tcp:41:lfs.0 Request processed in 196us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264355.995881:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00100000:1.0:1789264355.998699:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264355.999352:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311249280 00000100:00100000:3.0:1789264355.999362:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311249280 00000100:00100000:3.0:1789264355.999443:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:3.0:1789264355.999454:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+6:14981:x1876179311249280:12345-192.168.203.44@tcp:41:lfs.0 00000004:00000024:3.0:1789264355.999488:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789264355.999584:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+6:14981:x1876179311249280:12345-192.168.203.44@tcp:41:lfs.0 Request processed in 131us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264355.999591:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00080000:1.0:1789264355.999741:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789264356.004002:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264356.004148:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311249408 00000100:00100000:3.0:1789264356.004162:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311249408 00000100:00100000:3.0:1789264356.004276:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:3.0:1789264356.004286:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd292616-4ff1-43bd-9855-5a9de2560302+6:14981:x1876179311249408:12345-192.168.203.44@tcp:13:lfs.0 00002000:00000024:3.0:1789264356.004317:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789264356.004422:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd292616-4ff1-43bd-9855-5a9de2560302+6:14981:x1876179311249408:12345-192.168.203.44@tcp:13:lfs.0 Request processed in 136us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264356.004430:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00080000:1.0:1789264356.005483:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264356.008609:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264356.008955:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311249536 00000100:00100000:3.0:1789264356.008975:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311249536 00000100:00100000:3.0:1789264356.009171:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:3.0:1789264356.009182:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd292616-4ff1-43bd-9855-5a9de2560302+6:14981:x1876179311249536:12345-192.168.203.44@tcp:13:lfs.0 00002000:00000024:3.0:1789264356.009212:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789264356.009358:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd292616-4ff1-43bd-9855-5a9de2560302+6:14981:x1876179311249536:12345-192.168.203.44@tcp:13:lfs.0 Request processed in 178us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264356.009366:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00080000:1.0:1789264356.010263:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789264356.154889:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264356.155021:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311249664 00000100:00100000:1.0:1789264356.155031:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311249664 00000100:00100000:1.0:1789264356.155088:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 128 00000100:00100000:1.0:1789264356.155098:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a9250d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+10:15013:x1876179311249664:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789264356.155114:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264356.155132:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3abb9fe000/0xecaf9f2f14ed8228 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaed5 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264356.155159:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3abb9fe000/0xecaf9f2f14ed8228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaed5 expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264356.155170:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3abb9fe000/0xecaf9f2f14ed8228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaed5 expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264356.155180:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abb9fe000, rc 0) 00000100:00100000:1.0:1789264356.155246:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a9250d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+11:15013:x1876179311249664:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 150us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264356.155252:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 128 00000100:00100000:1.0:1789264356.158153:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264356.158379:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311249792 00000100:00100000:2.0:1789264356.158389:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311249792 00000100:00100000:2.0:1789264356.158527:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 129 00000100:00100000:2.0:1789264356.158538:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a9250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+11:15013:x1876179311249792:12345-192.168.203.44@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789264356.158714:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a9250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+11:15013:x1876179311249792:12345-192.168.203.44@tcp:501:mount.lustre.0 Request processed in 177us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264356.158721:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 129 00000100:00100000:2.0:1789264356.162979:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264356.163067:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311249920 00000100:00100000:0.0:1789264356.163076:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311249920 00000100:00100000:0.0:1789264356.163131:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 130 00000100:00100000:0.0:1789264356.163140:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+11:15013:x1876179311249920:12345-192.168.203.44@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789264356.163356:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+11:15013:x1876179311249920:12345-192.168.203.44@tcp:503:mount.lustre.0 Request processed in 216us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264356.163364:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 130 00000100:00100000:0.0:1789264356.192433:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264356.192538:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311250048 00000100:00100000:2.0:1789264356.192547:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311250048 00000100:00100000:2.0:1789264356.192596:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 131 00000100:00100000:2.0:1789264356.192846:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+11:15020:x1876179311250048:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789264356.193018:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+11:15020:x1876179311250048:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 174us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264356.193026:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 131 00000100:00100000:2.0:1789264356.221629:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264356.221732:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311250176 00000100:00100000:1.0:1789264356.221772:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311250176 00000100:00100000:1.0:1789264356.221826:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 132 00000100:00100000:1.0:1789264356.221837:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+11:15020:x1876179311250176:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789264356.222038:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+11:15020:x1876179311250176:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 201us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264356.222047:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 132 00000100:00100000:3.0:1789264356.227660:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264356.228155:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311250304 00000100:00100000:0.0:1789264356.228165:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311250304 00000100:00100000:0.0:1789264356.228224:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 133 00000100:00100000:0.0:1789264356.228234:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+11:15020:x1876179311250304:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789264356.228405:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+11:15020:x1876179311250304:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 171us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264356.228412:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 133 00010000:00010000:3.0:1789264356.235847:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264356.240074:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264356.240180:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311250432 00000100:00100000:2.0:1789264356.240191:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311250432 00000100:00100000:2.0:1789264356.240260:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 134 00000100:00100000:2.0:1789264356.240271:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+11:15013:x1876179311250432:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789264356.240287:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264356.240309:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3abac1d600/0xecaf9f2f14ed822f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf06 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264356.240337:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3abac1d600/0xecaf9f2f14ed822f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf06 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264356.240348:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3abac1d600/0xecaf9f2f14ed822f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf06 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264356.240357:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1d600, rc 0) 00000100:00100000:2.0:1789264356.240424:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+12:15013:x1876179311250432:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 155us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264356.240432:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 134 00000100:00100000:2.0:1789264356.243182:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264356.243504:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311250560 00000100:00100000:1.0:1789264356.243528:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311250560 00000100:00100000:1.0:1789264356.243582:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 135 00000100:00100000:1.0:1789264356.243593:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+12:15013:x1876179311250560:12345-192.168.203.44@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789264356.243615:0:17198:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789264356.243633:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789264356.243638:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789264356.243641:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789264356.243653:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789264356.243655:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789264356.248439:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+12:15013:x1876179311250560:12345-192.168.203.44@tcp:256:mount.lustre.0 Request processed in 4837us (5256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264356.248454:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 135 00000100:00100000:0.0:1789264356.251684:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264356.251781:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311250688 00000100:00100000:2.0:1789264356.251792:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311250688 00000100:00100000:2.0:1789264356.251853:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 136 00000100:00100000:2.0:1789264356.251878:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+12:15013:x1876179311250688:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789264356.251895:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264356.251911:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3abac1c200/0xecaf9f2f14ed8236 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf0d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264356.251940:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3abac1c200/0xecaf9f2f14ed8236 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf0d expref: 13 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264356.251951:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3abac1c200/0xecaf9f2f14ed8236 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf0d expref: 13 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264356.251960:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c200, rc 0) 00000100:00100000:2.0:1789264356.252088:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:15013:x1876179311250688:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 212us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264356.252095:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 136 00000100:00100000:2.0:1789264356.257088:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264356.257521:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311250816 00000100:00100000:1.0:1789264356.257531:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311250816 00000100:00100000:1.0:1789264356.257738:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 137 00000100:00100000:1.0:1789264356.257777:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:15013:x1876179311250816:12345-192.168.203.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789264356.257929:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:15013:x1876179311250816:12345-192.168.203.44@tcp:501:mount.lustre.0 Request processed in 154us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264356.257937:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 137 00000100:00100000:2.0:1789264356.261793:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264356.261897:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311250944 00000100:00100000:0.0:1789264356.261907:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311250944 00000100:00100000:0.0:1789264356.261960:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 138 00000100:00100000:0.0:1789264356.261969:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:15013:x1876179311250944:12345-192.168.203.44@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789264356.262123:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:15013:x1876179311250944:12345-192.168.203.44@tcp:503:mount.lustre.0 Request processed in 155us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264356.262131:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 138 00000100:00100000:2.0:1789264356.269807:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264356.270496:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311251072 00000100:00100000:1.0:1789264356.270506:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311251072 00000100:00100000:1.0:1789264356.270566:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 139 00000100:00100000:1.0:1789264356.270576:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:15026:x1876179311251072:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789264356.270801:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:15026:x1876179311251072:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 225us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264356.270809:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 139 00000100:00100000:1.0:1789264356.274363:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264356.274516:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311251200 00000100:00100000:2.0:1789264356.274526:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311251200 00000100:00100000:2.0:1789264356.274581:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 140 00000100:00100000:2.0:1789264356.274591:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:15026:x1876179311251200:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789264356.274843:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:15026:x1876179311251200:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 253us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264356.274852:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 140 00000100:00100000:2.0:1789264356.280585:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264356.280625:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264356.280676:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264356.280928:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311251456 00000100:00100000:1.0:1789264356.280939:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311251456 00000100:00100000:1.0:1789264356.280986:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311251584 00000100:00100000:1.0:1789264356.280989:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311251584 00000100:00100000:1.0:1789264356.281019:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:1.0:1789264356.281030:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+7:2403:x1876179311251456:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264356.281100:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+7:2403:x1876179311251456:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 72us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264356.281109:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:1.0:1789264356.281127:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:1.0:1789264356.281134:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+6:2403:x1876179311251584:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264356.281159:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+6:2403:x1876179311251584:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264356.281165:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:2.0:1789264356.281459:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264356.281558:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311251712 00000100:00100000:3.0:1789264356.281563:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311251712 00000100:00100000:3.0:1789264356.281591:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311251840 00000100:00100000:3.0:1789264356.281594:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311251840 00000100:00100000:3.0:1789264356.281614:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:3.0:1789264356.281620:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd292616-4ff1-43bd-9855-5a9de2560302+6:2403:x1876179311251712:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264356.281660:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd292616-4ff1-43bd-9855-5a9de2560302+6:2403:x1876179311251712:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 40us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264356.281666:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:3.0:1789264356.281680:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:3.0:1789264356.281687:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd292616-4ff1-43bd-9855-5a9de2560302+6:2403:x1876179311251840:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1789264356.281709:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd292616-4ff1-43bd-9855-5a9de2560302+6:2403:x1876179311251840:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 23us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264356.281715:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:0.0:1789264356.290231:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264356.290268:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264356.290452:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311251328 00000100:00100000:2.0:1789264356.290461:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311251328 00000100:00100000:2.0:1789264356.290707:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311252096 00000100:00100000:2.0:1789264356.290712:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311252096 00000100:00100000:3.0:1789264356.291757:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:3.0:1789264356.291767:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1876179311251328:12345-192.168.203.44@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789264356.291803:0:17203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3542bc01-ba46-418a-baf3-94035bd58f4f@192.168.203.44@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1789264356.291853:0:17203:0:(genops.c:1385:class_connect()) connect: client 3542bc01-ba46-418a-baf3-94035bd58f4f, cookie 0xecaf9f2f14ed823d 00000004:00100000:3.0:1789264356.291879:0:17203:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789264356.291971:0:17203:0:(import.c:65:import_set_state_nolock()) ffff9c3aaff86800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789264356.292106:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+6:2401:x1876179311251328:12345-192.168.203.44@tcp:38:mount.lustre.0 Request processed in 337us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264356.292115:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:3.0:1789264356.292138:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:3.0:1789264356.292143:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1876179311252096:12345-192.168.203.44@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789264356.292159:0:17203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 3542bc01-ba46-418a-baf3-94035bd58f4f@192.168.203.44@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1789264356.292197:0:17203:0:(genops.c:1385:class_connect()) connect: client 3542bc01-ba46-418a-baf3-94035bd58f4f, cookie 0xecaf9f2f14ed8244 00000004:00100000:3.0:1789264356.292210:0:17203:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789264356.292728:0:17203:0:(import.c:65:import_set_state_nolock()) ffff9c3aaff85800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789264356.292778:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+6:2401:x1876179311252096:12345-192.168.203.44@tcp:38:mount.lustre.0 Request processed in 632us (2509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264356.292785:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:2.0:1789264356.299025:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264356.299170:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311251968 00000100:00100000:1.0:1789264356.299180:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311251968 00000100:00100000:1.0:1789264356.299306:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:1.0:1789264356.299316:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3542bc01-ba46-418a-baf3-94035bd58f4f+6:0:x1876179311251968:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789264356.299348:0:18643:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00080000:3.0:1789264356.300919:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264356.301383:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264356.301813:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3542bc01-ba46-418a-baf3-94035bd58f4f+6:0:x1876179311251968:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 2495us (2794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264356.301825:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:0.0:1789264356.301857:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311252224 00000100:00100000:0.0:1789264356.301863:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311252224 00000100:00080000:3.0:1789264356.301943:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789264356.302257:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:0.0:1789264356.302268:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3542bc01-ba46-418a-baf3-94035bd58f4f+6:0:x1876179311252224:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789264356.302364:0:18643:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789264356.302367:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264356.302389:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311252352 00000100:00100000:2.0:1789264356.302392:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311252352 00000100:00100000:0.0:1789264356.302411:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3542bc01-ba46-418a-baf3-94035bd58f4f+6:0:x1876179311252224:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 145us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264356.302417:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:0.0:1789264356.302431:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:0.0:1789264356.302438:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8f349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3542bc01-ba46-418a-baf3-94035bd58f4f+6:15013:x1876179311252352:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789264356.302450:0:18643:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789264356.302478:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8f349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3542bc01-ba46-418a-baf3-94035bd58f4f+6:15013:x1876179311252352:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 41us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264356.302484:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:0.0:1789264356.303928:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264356.303993:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311252480 00000100:00100000:2.0:1789264356.304000:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311252480 00000100:00100000:2.0:1789264356.304042:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:2.0:1789264356.304050:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3542bc01-ba46-418a-baf3-94035bd58f4f+6:15013:x1876179311252480:12345-192.168.203.44@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789264356.304169:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3542bc01-ba46-418a-baf3-94035bd58f4f+6:15013:x1876179311252480:12345-192.168.203.44@tcp:40:mount.lustre.0 Request processed in 119us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264356.304177:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:1.0:1789264356.306006:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264356.306095:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264356.306200:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264356.306276:0:19101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311252608 00000100:00100000:0.0:1789264356.306284:0:19101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311252608 00000100:00100000:2.0:1789264356.306344:0:19872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311252736 00000100:00100000:2.0:1789264356.306348:0:19872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311252736 00000100:00100000:3.0:1789264356.306419:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311252864 00000100:00100000:3.0:1789264356.306423:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311252864 00000100:00100000:3.0:1789264356.306547:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:3.0:1789264356.306557:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3542bc01-ba46-418a-baf3-94035bd58f4f+6:15013:x1876179311252864:12345-192.168.203.44@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789264356.306579:0:19101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:0.0:1789264356.306584:0:19101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1876179311252736:12345-192.168.203.44@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789264356.306609:0:19101:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3542bc01-ba46-418a-baf3-94035bd58f4f@192.168.203.44@tcp t0 exp 0000000000000000 cur 436 last 0 00000100:00100000:3.0:1789264356.306619:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3542bc01-ba46-418a-baf3-94035bd58f4f+6:15013:x1876179311252864:12345-192.168.203.44@tcp:900:mount.lustre.0 Request processed in 65us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264356.306625:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 4 00000020:00000080:0.0:1789264356.306637:0:19101:0:(genops.c:1385:class_connect()) connect: client 3542bc01-ba46-418a-baf3-94035bd58f4f, cookie 0xecaf9f2f14ed824b 00002000:00100000:0.0:1789264356.306660:0:19101:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3542bc01-ba46-418a-baf3-94035bd58f4f/ffff9c3aaff12800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1789264356.306661:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00002000:00100000:0.0:1789264356.306670:0:19101:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789264356.306672:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1876179311252608:12345-192.168.203.44@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789264356.306686:0:18711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3542bc01-ba46-418a-baf3-94035bd58f4f@192.168.203.44@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1789264356.306702:0:18711:0:(genops.c:1385:class_connect()) connect: client 3542bc01-ba46-418a-baf3-94035bd58f4f, cookie 0xecaf9f2f14ed8252 00002000:00100000:3.0:1789264356.306707:0:18711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3542bc01-ba46-418a-baf3-94035bd58f4f/ffff9c3aaff83000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789264356.306712:0:18711:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789264356.306765:0:19101:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:3.0:1789264356.306769:0:18711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789264356.306791:0:18711:0:(import.c:65:import_set_state_nolock()) ffff9c3aaff85000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789264356.306791:0:19101:0:(import.c:65:import_set_state_nolock()) ffff9c3aaff14000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789264356.306818:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3542bc01-ba46-418a-baf3-94035bd58f4f+6:2401:x1876179311252608:12345-192.168.203.44@tcp:8:mount.lustre.0 Request processed in 145us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264356.306821:0:19101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3542bc01-ba46-418a-baf3-94035bd58f4f+6:2401:x1876179311252736:12345-192.168.203.44@tcp:8:mount.lustre.0 Request processed in 237us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264356.306825:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:0.0:1789264356.306828:0:19101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:3.0:1789264356.308477:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264356.308734:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311252992 00000100:00100000:2.0:1789264356.308776:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311252992 00000100:00100000:2.0:1789264356.308827:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:2.0:1789264356.308837:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3542bc01-ba46-418a-baf3-94035bd58f4f+6:15013:x1876179311252992:12345-192.168.203.44@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789264356.308926:0:17207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789264356.309006:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3542bc01-ba46-418a-baf3-94035bd58f4f+6:15013:x1876179311252992:12345-192.168.203.44@tcp:33:mount.lustre.0 Request processed in 170us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264356.309013:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:0.0:1789264356.500565:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264356.500725:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311253120 00000100:00100000:2.0:1789264356.500734:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311253120 00000100:00100000:2.0:1789264356.500807:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:2.0:1789264356.500817:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+6:15049:x1876179311253120:12345-192.168.203.44@tcp:101:mkdir.0 00010000:00010000:2.0:1789264356.500835:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264356.500858:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed8259 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf3e expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264356.500919:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed8260 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264356.500932:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed8260 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264356.500945:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed8260 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264356.500988:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789264356.500991:0:17203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264356.501013:0:17203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed8260 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264356.501039:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c000/0xecaf9f2f14ed8259 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf3e expref: 8 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264356.501057:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed8260 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf3e expref: 7 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264356.501066:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983361200) 00010000:00010000:2.0:1789264356.501069:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789264356.501174:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45400, rc 0) 00000100:00100000:2.0:1789264356.501378:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+7:15049:x1876179311253120:12345-192.168.203.44@tcp:101:mkdir.0 Request processed in 562us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264356.501386:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00010000:00010000:3.0:1789264357.259062:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264357.386884:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322840704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789264357.386943:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264357.387006:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322840704 00000100:00100000:0.0:1789264357.387012:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322840704 00000100:00100000:0.0:1789264357.387060:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789264357.387069:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322840704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789264357.387089:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789264357.387136:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876179322840704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264357.387144:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789264357.387180:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322840960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789264357.387210:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264357.387241:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322840832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264357.387284:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264357.387379:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322840960 00000100:00100000:0.0:1789264357.387384:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322840960 00000100:00100000:0.0:1789264357.387402:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322840832 00000100:00100000:0.0:1789264357.387405:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322840832 00000100:00100000:0.0:1789264357.387431:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789264357.387437:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1876179322840960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789264357.387447:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789264357.387477:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1876179322840960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264357.387483:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789264357.387494:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789264357.387500:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1876179322840832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789264357.387509:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789264357.387530:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1876179322840832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264357.387535:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789264357.387552:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789264357.387555:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264357.387568:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322841216:0@lo:400:kworker.0 00000100:00100000:1.0:1789264357.387579:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3625:1876179322841088:0@lo:400:kworker.0 00000100:00100000:0.0:1789264357.387596:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264357.387622:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264357.387630:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322841728:0@lo:400:kworker.0 00000100:00100000:1.0:1789264357.387665:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322841600:0@lo:400:kworker.0 00000100:00100000:0.0:1789264357.387675:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264357.387699:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322842240:0@lo:400:kworker.0 00000100:00100000:1.0:1789264357.387701:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264357.387730:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322842112:0@lo:400:kworker.0 00000100:00100000:0.0:1789264357.387732:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264357.387980:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1876179322840704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789264357.387998:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789264357.388003:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322841344:0@lo:400:kworker.0 00000100:00100000:0.0:1789264357.388025:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264357.388042:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322841856:0@lo:400:kworker.0 00000100:00100000:0.0:1789264357.388068:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264357.388093:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322841728 00000100:00100000:0.0:1789264357.388097:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322841728 00000100:00100000:0.0:1789264357.388122:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322842240 00000100:00100000:0.0:1789264357.388125:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322842240 00000100:00100000:0.0:1789264357.388140:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322841856 00000100:00100000:0.0:1789264357.388143:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322841856 00000100:00100000:0.0:1789264357.388723:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789264357.388732:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322841728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264357.388809:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322841728:12345-0@lo:400:kworker.0 Request processed in 78us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264357.388816:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789264357.388831:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789264357.388838:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322842240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264357.388866:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322842240:12345-0@lo:400:kworker.0 Request processed in 29us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264357.388872:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789264357.388883:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789264357.388889:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322841856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264357.388914:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322841856:12345-0@lo:400:kworker.0 Request processed in 25us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264357.388919:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789264357.388942:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322841344 00000100:00100000:0.0:1789264357.388946:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322841344 00000100:00100000:0.0:1789264357.388973:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789264357.388979:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322841344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264357.389024:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322841344:12345-0@lo:400:kworker.0 Request processed in 45us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264357.389038:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789264357.389062:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789264357.389066:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789264357.389068:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789264357.389093:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322841344:0@lo:400:kworker.0 00000100:00100000:0.0:1789264357.389105:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322841856:0@lo:400:kworker.0 00000100:00100000:0.0:1789264357.389125:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322841728:0@lo:400:kworker.0 00010000:00080000:0.0:1789264357.389137:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ff1880 x1876179322842240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264357.390785:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264357.390831:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789264357.390842:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322841472:0@lo:400:kworker.0 00000100:00100000:1.0:1789264357.390875:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264357.390904:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322841984:0@lo:400:kworker.0 00000100:00100000:1.0:1789264357.390935:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264357.390979:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322842240:0@lo:400:kworker.0 00000100:00100000:1.0:1789264357.391003:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322840960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789264357.391042:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322841216 00000100:00100000:1.0:1789264357.391048:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322841216 00000100:00100000:1.0:1789264357.391082:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322841600 00000100:00100000:1.0:1789264357.391085:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322841600 00000100:00100000:1.0:1789264357.391105:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789264357.391113:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322841216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264357.391170:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322841216:12345-0@lo:400:kworker.0 Request processed in 57us (3574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264357.391177:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789264357.391193:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789264357.391199:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322841600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264357.391232:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322841600:12345-0@lo:400:kworker.0 Request processed in 34us (3533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264357.391240:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322842112 00000100:00100000:3.0:1789264357.391247:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322842112 00000100:00100000:1.0:1789264357.391251:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789264357.391278:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322841088 00000100:00100000:1.0:1789264357.391283:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322841088 00000100:00100000:1.0:1789264357.391312:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789264357.391318:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8920b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:3625:x1876179322841088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264357.391350:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8920b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:3625:x1876179322841088:12345-0@lo:400:kworker.0 Request processed in 31us (3729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264357.391355:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789264357.391390:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3625:1876179322841088:0@lo:400:kworker.0 00000100:00100000:1.0:1789264357.391403:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322841600:0@lo:400:kworker.0 00000100:00100000:1.0:1789264357.391435:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322840832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789264357.391451:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322841472 00000100:00100000:1.0:1789264357.391455:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322841984 00000100:00100000:3.0:1789264357.391458:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322841472 00000100:00100000:1.0:1789264357.391460:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322841984 00000100:00100000:1.0:1789264357.391493:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789264357.391500:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789264357.391505:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322842112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264357.391512:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322841984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264357.391553:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322842112:12345-0@lo:400:kworker.0 Request processed in 52us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264357.391560:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789264357.391564:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322841984:12345-0@lo:400:kworker.0 Request processed in 54us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264357.391573:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789264357.391582:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789264357.391591:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322841472:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789264357.391599:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789264357.391605:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789264357.391622:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322841472:12345-0@lo:400:kworker.0 Request processed in 32us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264357.391628:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789264357.391667:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322841472:0@lo:400:kworker.0 00010000:00080000:1.0:1789264357.391690:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ff3b80 x1876179322841984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264357.391701:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322841984:0@lo:400:kworker.0 00000100:00100000:1.0:1789264357.391711:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322842112:0@lo:400:kworker.0 00000100:00100000:1.0:1789264357.391970:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322841216:0@lo:400:kworker.0 00000001:00100000:1.0:1789264357.392868:0:17184:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3542bc01-ba46-418a-baf3-94035bd58f4f 00000001:00100000:1.0:1789264357.392877:0:17184:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dd292616-4ff1-43bd-9855-5a9de2560302 00000001:00100000:3.0:1789264357.398827:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3542bc01-ba46-418a-baf3-94035bd58f4f 00000001:00100000:3.0:1789264357.398842:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd292616-4ff1-43bd-9855-5a9de2560302 00000001:00080000:3.0:1789264357.398849:0:19526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:3.0:1789264357.398869:0:19526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1789264357.898404:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789264357.898430:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322842368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789264357.898501:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264357.898838:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322842368 00000100:00100000:3.0:1789264357.898848:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322842368 00000100:00100000:3.0:1789264357.900699:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789264357.900717:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322842368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789264357.900762:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789264357.900841:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322842368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (2339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264357.900848:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789264357.900942:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322842368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789264358.285786:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789264358.708252:0:20083:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789264358.921988:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789264358.922013:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322842496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789264358.922082:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264358.922212:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789264358.922222:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322842624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789264358.922251:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264358.922331:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322842496 00000100:00100000:1.0:1789264358.922340:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322842496 00000100:00100000:1.0:1789264358.922392:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322842624 00000100:00100000:1.0:1789264358.922396:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322842624 00000100:00100000:1.0:1789264358.922411:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789264358.922420:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322842496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789264358.922454:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789264358.922512:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322842496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264358.922523:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789264358.922540:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789264358.922546:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322842624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789264358.922563:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789264358.922602:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322842624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264358.922633:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789264358.922718:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322842624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789264358.922718:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322842496:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789264359.308795:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789264359.437352:0:18706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3542bc01-ba46-418a-baf3-94035bd58f4f 00000001:00100000:1.0:1789264359.437363:0:18706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd292616-4ff1-43bd-9855-5a9de2560302 00000001:00100000:2.0:1789264359.440335:0:17936:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3542bc01-ba46-418a-baf3-94035bd58f4f 00000001:00100000:2.0:1789264359.440345:0:17936:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of dd292616-4ff1-43bd-9855-5a9de2560302 00000040:00080000:3.0:1789264359.563104:0:17239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789264360.330983:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789264360.779774:0:17956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789264361.355326:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789264361.393826:0:20230:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeda5c73a0 20000000:00000080:3.0:1789264361.393849:0:20230:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c3aaf657400 uarg=0000000000000000 20000000:01000000:3.0:1789264361.393904:0:20230:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789264361.393911:0:20230:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789264361.393917:0:20230:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789264361.394730:0:20231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1789264361.395010:0:20230:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789264361.402006:0:20230:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789264361.402314:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.402340:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3983e45a00/0xecaf9f2f14ed7efc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7ef5 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.402349:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c39836ca000/0xecaf9f2f14ed7f0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f03 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.402357:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3abac1c600/0xecaf9f2f14ed7f49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed7f42 expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.402364:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c398366a200/0xecaf9f2f14ed80a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed80a0 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.402374:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed81f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae9d expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.402399:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c3abac1c200/0xecaf9f2f14ed8236 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf0d expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.402408:0:20230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.402459:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3abac1c200/0xecaf9f2f14ed8236 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf0d expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.402479:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3abac1c200/0xecaf9f2f14ed8236 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf0d expref: 12 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264361.402497:0:20230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983621880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1876179322842752:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264361.402670:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed81f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae9d expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.402680:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed81f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae9d expref: 12 pid: 17196 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264361.402688:0:20230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983621c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1876179322842880:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264361.402720:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c398366a200/0xecaf9f2f14ed80a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed80a0 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.402812:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c398366a200/0xecaf9f2f14ed80a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed80a0 expref: 23 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264361.402822:0:20230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983623480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1876179322843008:0@lo:104: 00000100:00100000:2.0:1789264361.402878:0:20230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789264361.402941:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3abac1c600/0xecaf9f2f14ed7f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed7f42 expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.402949:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3abac1c600/0xecaf9f2f14ed7f49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f42 expref: 23 pid: 17198 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264361.402957:0:20230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983623800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1876179322843136:0@lo:104: 00000100:00100000:2.0:1789264361.402977:0:20230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789264361.403114:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c39836ca000/0xecaf9f2f14ed7f0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed7f03 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.403123:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c39836ca000/0xecaf9f2f14ed7f0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f03 expref: 23 pid: 17196 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264361.403132:0:20230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983110000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1876179322843264:0@lo:104: 00000100:00100000:1.0:1789264361.403182:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322843008 00000100:00100000:1.0:1789264361.403204:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322843008 00000100:00100000:2.0:1789264361.403213:0:20230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789264361.403304:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c3983e45a00/0xecaf9f2f14ed7efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xecaf9f2f14ed7ef5 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.403312:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c3983e45a00/0xecaf9f2f14ed7efc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ef5 expref: 23 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264361.403320:0:20230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983113480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1876179322843392:0@lo:104: 00000100:00100000:2.0:1789264361.403346:0:20230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264361.405118:0:18737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322843264 00000100:00100000:0.0:1789264361.405135:0:18737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322843264 00000100:00100000:0.0:1789264361.405183:0:18737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322843392 00000100:00100000:0.0:1789264361.405187:0:18737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322843392 00000100:00100000:0.0:1789264361.405207:0:18737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789264361.405217:0:18737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+5:20230:x1876179322843008:12345-0@lo:104: 00000100:00100000:2.0:1789264361.405330:0:20230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789264361.405406:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789264361.405419:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+5:20230:x1876179322843264:12345-0@lo:104: 00010000:00010000:3.0:1789264361.405545:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7f0a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264361.405573:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322843136 00000100:00100000:1.0:1789264361.405580:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322843136 00010000:00010000:0.0:1789264361.405625:0:18737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed80a7 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.406358:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789264361.406368:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+6:20230:x1876179322843264:12345-0@lo:104: Request processed in 952us (3153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264361.406389:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789264361.406419:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789264361.406428:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983110700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+5:20230:x1876179322843392:12345-0@lo:104: 00010000:00010000:0.0:1789264361.406469:0:18737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789264361.406477:0:18737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+5:20230:x1876179322843008:12345-0@lo:104: Request processed in 1261us (3599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264361.406484:0:18737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789264361.406503:0:18737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789264361.406510:0:18737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+4:20230:x1876179322843136:12345-0@lo:104: 00010000:00010000:0.0:1789264361.406522:0:18737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7f49 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264361.406562:0:18737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789264361.406567:0:18737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+4:20230:x1876179322843136:12345-0@lo:104: Request processed in 59us (3590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264361.406573:0:18737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789264361.406959:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789264361.406967:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7f0a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264361.406975:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c400 already unused, calling callback (ffffffffc148ec20) 00010000:00010000:1.0:1789264361.407004:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789264361.407012:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed80a7 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264361.407021:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1dc00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1789264361.407024:0:18738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed80a7 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264361.407033:0:18738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed80a7 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264361.407042:0:18738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed80a7 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264361.407048:0:18738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789264361.407097:0:18738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed80a7 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264361.407104:0:18738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789264361.407110:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed7f0a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264361.407123:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed7f0a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789264361.407131:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed7f0a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264361.407140:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed80a7 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264361.407149:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789264361.407153:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3abac1dc00/0xecaf9f2f14ed80a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed80a7 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264361.407169:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7f0a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264361.407171:0:18738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789264361.407178:0:18738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7f49 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264361.407180:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264361.407190:0:18738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cb200 already unused, calling callback (ffffffffc148ec20) 00010000:00010000:0.0:1789264361.407191:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7f0a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264361.407194:0:18738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed7f49 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264361.407210:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c3abac1c400/0xecaf9f2f14ed7f03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7f0a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264361.407212:0:18738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed7f49 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789264361.407225:0:18738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed7f49 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789264361.407232:0:18738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789264361.407240:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264361.407243:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789264361.407245:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264361.407249:0:18738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7f49 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264361.407256:0:18738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789264361.407282:0:18738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7f49 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264361.407289:0:18738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c39836cb200/0xecaf9f2f14ed7f42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7f49 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264361.407310:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264361.407311:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789264361.407313:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789264361.407343:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39845eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3622:1876179322843520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789264361.407397:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7efc expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264361.407520:0:20230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983623480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1876179322843008:0@lo:104: 00010000:00010000:3.0:1789264361.407524:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789264361.407533:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983110700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+3:20230:x1876179322843392:12345-0@lo:104: Request processed in 1107us (4185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264361.407535:0:20230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983623800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1876179322843136:0@lo:104: 00000100:00100000:3.0:1789264361.407551:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789264361.407554:0:20230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983110000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1876179322843264:0@lo:104: 00000100:00100000:2.0:1789264361.407566:0:20230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983113480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1876179322843392:0@lo:104: 00010000:00010000:3.0:1789264361.407581:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264361.407588:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xecaf9f2f14ed7efc expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264361.407589:0:20230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1876179322842752:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264361.407602:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cb600 already unused, calling callback (ffffffffc148ec20) 00000100:00100000:2.0:1789264361.407606:0:20230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983621c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1876179322842880:192.168.203.44@tcp:104: 10000000:00010000:3.0:1789264361.407618:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xecaf9f2f14ed7efc expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.407629:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xecaf9f2f14ed7efc expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789264361.407636:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xecaf9f2f14ed7efc expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789264361.407642:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789264361.407664:0:20230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264361.407723:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39845edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3624:1876179322843776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789264361.408118:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264361.408185:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322843776 00000100:00100000:0.0:1789264361.408193:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322843776 00010000:00010000:3.0:1789264361.408202:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7efc expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.408210:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789264361.408224:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7efc expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.408231:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9c39836cb600/0xecaf9f2f14ed7ef5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xecaf9f2f14ed7efc expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.408254:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264361.408256:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264361.408257:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264361.408364:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264361.408395:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311253248 00000100:00100000:3.0:1789264361.408400:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311253248 00010000:00010000:3.0:1789264361.408420:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3abac1c200/0xecaf9f2f14ed8236 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf0d expref: 13 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264361.408552:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264361.408578:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789264361.408586:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3622:1876179322843648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264361.408605:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264361.408644:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3625:1876179322843904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264361.408756:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264361.408783:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322843520 00000100:00100000:1.0:1789264361.408787:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322843520 00010000:00010000:1.0:1789264361.408804:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c398366a200/0xecaf9f2f14ed80a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed80a0 expref: 25 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264361.408823:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322843648 00000100:00100000:1.0:1789264361.408826:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322843648 00010000:00010000:1.0:1789264361.408836:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c39836ca000/0xecaf9f2f14ed7f0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f03 expref: 26 pid: 17196 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264361.408848:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322843904 00000100:00100000:1.0:1789264361.408851:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322843904 00000100:00100000:3.0:1789264361.409098:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789264361.409119:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+27:3622:x1876179322843520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789264361.409136:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264361.409142:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c398366a200/0xecaf9f2f14ed80a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed80a0 expref: 27 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.409153:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c398366a200/0xecaf9f2f14ed80a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed80a0 expref: 27 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.409169:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c398366a200/0xecaf9f2f14ed80a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed80a0 expref: 27 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.409186:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264361.409229:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+26:3622:x1876179322843520:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264361.409237:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789264361.409255:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789264361.409262:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+25:3622:x1876179322843648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789264361.409280:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264361.409284:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c39836ca000/0xecaf9f2f14ed7f0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f03 expref: 25 pid: 17196 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.409293:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c39836ca000/0xecaf9f2f14ed7f0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f03 expref: 25 pid: 17196 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.409304:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c39836ca000/0xecaf9f2f14ed7f0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f03 expref: 25 pid: 17196 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.409314:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264361.409337:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:3622:x1876179322843648:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264361.409343:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789264361.409357:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:3.0:1789264361.409364:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:2403:x1876179311253248:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264361.409373:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264361.409378:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3abac1c200/0xecaf9f2f14ed8236 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf0d expref: 13 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.409388:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3abac1c200/0xecaf9f2f14ed8236 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf0d expref: 13 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.409398:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3abac1c200/0xecaf9f2f14ed8236 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf0d expref: 13 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.409409:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264361.409424:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3abac1c600/0xecaf9f2f14ed7f49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f42 expref: 23 pid: 17198 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264361.409448:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789264361.409457:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:3624:x1876179322843776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789264361.409466:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264361.409470:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3abac1c600/0xecaf9f2f14ed7f49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f42 expref: 23 pid: 17198 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264361.409478:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3abac1c600/0xecaf9f2f14ed7f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f42 expref: 23 pid: 17198 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264361.409496:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3abac1c600/0xecaf9f2f14ed7f49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed7f42 expref: 23 pid: 17198 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264361.409504:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3983e45a00/0xecaf9f2f14ed7efc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ef5 expref: 27 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264361.409506:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264361.409527:0:17190:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789264361.409538:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1789264361.409539:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:3624:x1876179322843776:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264361.409548:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789264361.409566:0:18356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789264361.409591:0:18356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39833c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:3625:x1876179322843904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789264361.409601:0:18356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264361.409606:0:18356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3983e45a00/0xecaf9f2f14ed7efc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ef5 expref: 21 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264361.409625:0:18356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3983e45a00/0xecaf9f2f14ed7efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ef5 expref: 21 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264361.409639:0:18356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3983e45a00/0xecaf9f2f14ed7efc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xecaf9f2f14ed7ef5 expref: 21 pid: 17199 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264361.409649:0:18356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264361.409773:0:18356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39833c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:3625:x1876179322843904:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264361.409780:0:18356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789264361.409834:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3625:1876179322843904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264361.409997:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3622:1876179322843648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264361.410010:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39845eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3622:1876179322843520:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789264361.410412:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789264361.410798:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+12:2403:x1876179311253248:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 1429us (2431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264361.410820:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:0.0:1789264361.410953:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264361.411021:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311253376 00000100:00100000:3.0:1789264361.411030:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311253376 00010000:00010000:3.0:1789264361.411057:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed81f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae9d expref: 12 pid: 17196 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264361.411092:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00100000:3.0:1789264361.411108:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+12:2402:x1876179311253376:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264361.411120:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264361.411125:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed81f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae9d expref: 12 pid: 17196 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.411139:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed81f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae9d expref: 12 pid: 17196 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.411155:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3abac1d000/0xecaf9f2f14ed81f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdae9d expref: 12 pid: 17196 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.411170:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.411179:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.411196:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.411204:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.411222:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.411230:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.411238:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45200 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264361.411243:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.411252:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.411274:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264361.411286:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264361.411325:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+11:2402:x1876179311253376:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 224us (373us total) trans 0 rc 0/0 00010000:00010000:2.0:1789264361.411325:0:20230:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264361.411341:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 14 00010000:00010000:2.0:1789264361.411343:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264361.411351:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed8267 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264361.412253:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39845edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3624:1876179322843776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789264361.425836:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264361.425881:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264361.425910:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264361.425930:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264361.425953:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264361.425975:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264361.425998:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264361.426055:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264361.426091:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311253504 00000100:00100000:1.0:1789264361.426104:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311253504 00000100:00100000:1.0:1789264361.426177:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311253632 00000100:00100000:1.0:1789264361.426191:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311253632 00000100:00100000:1.0:1789264361.426215:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311254016 00000100:00100000:1.0:1789264361.426218:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311254016 00000100:00100000:1.0:1789264361.426232:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311254144 00000100:00100000:1.0:1789264361.426235:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311254144 00000100:00100000:1.0:1789264361.426253:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:1.0:1789264361.426264:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+6:2403:x1876179311253504:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264361.426360:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+6:2403:x1876179311253504:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 97us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264361.426369:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:0.0:1789264361.426378:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:0.0:1789264361.426393:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+5:2403:x1876179311253632:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264361.426394:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:1.0:1789264361.426407:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3542bc01-ba46-418a-baf3-94035bd58f4f+6:2403:x1876179311254016:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264361.426433:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+5:2403:x1876179311253632:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 45us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264361.426444:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:1.0:1789264361.426445:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3542bc01-ba46-418a-baf3-94035bd58f4f+6:2403:x1876179311254016:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 37us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264361.426455:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:0.0:1789264361.426465:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:0.0:1789264361.426474:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3542bc01-ba46-418a-baf3-94035bd58f4f+5:2403:x1876179311254144:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264361.426484:0:19872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311253760 00000100:00100000:1.0:1789264361.426490:0:19872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311253760 00000100:00100000:0.0:1789264361.426498:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3542bc01-ba46-418a-baf3-94035bd58f4f+5:2403:x1876179311254144:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 25us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264361.426505:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:1.0:1789264361.426526:0:19872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311254272 00000100:00100000:1.0:1789264361.426530:0:19872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311254272 00000100:00100000:0.0:1789264361.426530:0:19101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311253888 00000100:00100000:0.0:1789264361.426535:0:19101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311253888 00000100:00100000:1.0:1789264361.426558:0:19872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311254400 00000100:00100000:1.0:1789264361.426563:0:19872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311254400 00000100:00100000:0.0:1789264361.426567:0:19101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:0.0:1789264361.426576:0:19101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd292616-4ff1-43bd-9855-5a9de2560302+5:2403:x1876179311253760:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264361.426591:0:19872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:0.0:1789264361.426603:0:19101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd292616-4ff1-43bd-9855-5a9de2560302+5:2403:x1876179311253760:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264361.426604:0:19872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3542bc01-ba46-418a-baf3-94035bd58f4f+5:2403:x1876179311254272:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264361.426630:0:19101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:1.0:1789264361.426645:0:19872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3542bc01-ba46-418a-baf3-94035bd58f4f+5:2403:x1876179311254272:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 44us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264361.426647:0:19101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:0.0:1789264361.426660:0:19101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd292616-4ff1-43bd-9855-5a9de2560302+5:2403:x1876179311253888:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264361.426661:0:19872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:1.0:1789264361.426683:0:19872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:0.0:1789264361.426692:0:19101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd292616-4ff1-43bd-9855-5a9de2560302+5:2403:x1876179311253888:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 34us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264361.426699:0:19101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:1.0:1789264361.426705:0:19872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3542bc01-ba46-418a-baf3-94035bd58f4f+5:2403:x1876179311254400:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1789264361.426736:0:19872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3542bc01-ba46-418a-baf3-94035bd58f4f+5:2403:x1876179311254400:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 38us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264361.426763:0:19872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00080000:3.0:1789264361.427542:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789264361.427549:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789264361.427552:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789264361.427554:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789264362.378281:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264362.506034:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789264362.506056:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322844032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789264362.506125:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264362.506170:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322844032 00000100:00100000:0.0:1789264362.506192:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322844032 00000100:00100000:0.0:1789264362.506243:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789264362.506253:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322844032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789264362.506279:0:18712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789264362.506319:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322844032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264362.506326:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789264362.506347:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789264362.506382:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322844032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789264362.507897:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322844160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789264362.507947:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264362.507987:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322844160 00000100:00100000:0.0:1789264362.507992:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322844160 00000100:00100000:0.0:1789264362.508031:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789264362.508040:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3aa98a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322844160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789264362.508079:0:18712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789264362.508118:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3aa98a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322844160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264362.508125:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789264362.508145:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789264362.508164:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934595 gen 2 00000100:00100000:0.0:1789264362.508193:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322844160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789264362.508886:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3aa98a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322844288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789264362.508919:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264362.509024:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3625:1876179322844416:0@lo:400:kworker.0 00000100:00100000:0.0:1789264362.509055:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264362.509271:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322844928:0@lo:400:kworker.0 00000100:00100000:0.0:1789264362.509298:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264362.509314:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322845440:0@lo:400:kworker.0 00000100:00100000:0.0:1789264362.509336:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264362.509354:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789264362.509359:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322844800:0@lo:400:kworker.0 00000100:00100000:0.0:1789264362.509376:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264362.509389:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322845312:0@lo:400:kworker.0 00000100:00100000:0.0:1789264362.509404:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264362.509428:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322844928 00000100:00100000:0.0:1789264362.509433:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322844928 00000100:00100000:0.0:1789264362.509469:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789264362.509477:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322844928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264362.509531:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322844928:12345-0@lo:400:kworker.0 Request processed in 54us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264362.509538:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789264362.509558:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322845440 00000100:00100000:0.0:1789264362.509561:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322845440 00000100:00100000:0.0:1789264362.509588:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322844800 00000100:00100000:0.0:1789264362.509590:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322844800 00000100:00100000:0.0:1789264362.509613:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322845312 00000100:00100000:0.0:1789264362.509616:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322845312 00000100:00100000:0.0:1789264362.509632:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789264362.509638:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322845440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264362.509668:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876179322845440:12345-0@lo:400:kworker.0 Request processed in 30us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264362.509674:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789264362.509684:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789264362.509689:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322844800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264362.509732:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876179322844800:12345-0@lo:400:kworker.0 Request processed in 42us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264362.509738:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789264362.509923:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322844416 00000100:00100000:1.0:1789264362.509928:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322844416 00000100:00100000:1.0:1789264362.509962:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789264362.509970:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a89209050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:3625:x1876179322844416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264362.510004:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a89209050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:3625:x1876179322844416:12345-0@lo:400:kworker.0 Request processed in 36us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264362.510010:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789264362.510041:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789264362.510048:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322845312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264362.510149:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876179322845312:12345-0@lo:400:kworker.0 Request processed in 101us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264362.510155:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789264362.510256:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322844544:0@lo:400:kworker.0 00000100:00100000:1.0:1789264362.510284:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264362.510303:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322845056:0@lo:400:kworker.0 00000100:00100000:1.0:1789264362.510322:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264362.510335:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322845568:0@lo:400:kworker.0 00000100:00100000:1.0:1789264362.510356:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264362.510369:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789264362.510375:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322844672:0@lo:400:kworker.0 00000100:00100000:1.0:1789264362.510394:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264362.510420:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322845184:0@lo:400:kworker.0 00000100:00100000:1.0:1789264362.510457:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264362.510477:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322845056 00000100:00100000:1.0:1789264362.510481:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322845056 00000100:00100000:1.0:1789264362.510497:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322845568 00000100:00100000:1.0:1789264362.510500:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322845568 00000100:00100000:1.0:1789264362.510513:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322845184 00000100:00100000:1.0:1789264362.510516:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322845184 00000100:00100000:1.0:1789264362.510528:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789264362.510533:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322845056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264362.510565:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1876179322845056:12345-0@lo:400:kworker.0 Request processed in 31us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264362.510571:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789264362.510582:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789264362.510588:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322845568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264362.511312:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789264362.511325:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322845184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789264362.511417:0:19101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322844672 00000100:00100000:0.0:1789264362.511422:0:19101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322844672 00000100:00100000:0.0:1789264362.511466:0:19101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789264362.511473:0:19101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322844672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264362.511530:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1876179322845184:12345-0@lo:400:kworker.0 Request processed in 208us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264362.511537:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1789264362.511559:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789264362.511563:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789264362.511565:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264362.511613:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876179322844800:0@lo:400:kworker.0 00010000:00080000:2.0:1789264362.511631:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ff3100 x1876179322845312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264362.511641:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1876179322845312:0@lo:400:kworker.0 00000100:00100000:2.0:1789264362.511662:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3625:1876179322844416:0@lo:400:kworker.0 00000100:00100000:2.0:1789264362.511674:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322844928:0@lo:400:kworker.0 00000100:00100000:2.0:1789264362.511688:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1876179322845440:0@lo:400:kworker.0 00000100:00100000:2.0:1789264362.511723:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322844288 00000100:00100000:2.0:1789264362.511726:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322844288 00000100:00100000:2.0:1789264362.511789:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789264362.511797:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322844288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789264362.511811:0:18712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789264362.511849:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322844288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (2929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264362.511855:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789264362.511870:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789264362.511886:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789264362.511902:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3aa98a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322844288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789264362.512294:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876179322845568:12345-0@lo:400:kworker.0 Request processed in 1704us (1934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264362.512303:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789264362.512335:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1876179322845184:0@lo:400:kworker.0 00000100:00100000:1.0:1789264362.512348:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876179322845056:0@lo:400:kworker.0 00010000:00080000:1.0:1789264362.512359:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983ff0a80 x1876179322845568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789264362.512368:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1876179322845568:0@lo:400:kworker.0 00000100:00100000:1.0:1789264362.512389:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322844544 00000100:00100000:1.0:1789264362.512393:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322844544 00000100:00100000:1.0:1789264362.512426:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789264362.512442:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322844544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789264362.512489:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322844544:12345-0@lo:400:kworker.0 Request processed in 48us (2204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264362.512496:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789264362.512594:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322844544:0@lo:400:kworker.0 00000100:00100000:0.0:1789264362.512738:0:19101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322844672:12345-0@lo:400:kworker.0 Request processed in 1264us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264362.514904:0:19101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789264362.515685:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322844672:0@lo:400:kworker.0 00000100:00100000:1.0:1789264362.958579:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264362.958634:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311254528 00000100:00100000:0.0:1789264362.958650:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311254528 00000100:00100000:0.0:1789264362.958710:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 143 00000100:00100000:0.0:1789264362.958722:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a89208450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+11:14895:x1876179311254528:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264362.958739:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264362.958925:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c398366a000/0xecaf9f2f14ed826e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf45 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264362.958955:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c398366a000/0xecaf9f2f14ed826e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf45 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264362.958967:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c398366a000/0xecaf9f2f14ed826e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf45 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264362.958976:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366a000, rc 0) 00000100:00100000:0.0:1789264362.959046:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a89208450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+12:14895:x1876179311254528:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 326us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264362.959052:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 143 00000100:00100000:2.0:1789264362.961830:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264362.961880:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311254656 00000100:00100000:2.0:1789264362.961890:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311254656 00000100:00100000:2.0:1789264362.961942:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 144 00000100:00100000:2.0:1789264362.961951:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a89208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+12:14895:x1876179311254656:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789264362.962105:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a89208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+12:14895:x1876179311254656:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 155us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264362.962114:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 144 00000100:00100000:1.0:1789264362.968314:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264362.968405:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311254784 00000100:00100000:2.0:1789264362.968414:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311254784 00000100:00100000:2.0:1789264362.968483:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 145 00000100:00100000:2.0:1789264362.968493:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a89209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+12:14895:x1876179311254784:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789264362.968640:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a89209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+12:14895:x1876179311254784:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 Request processed in 148us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264362.968649:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 145 00000100:00100000:1.0:1789264362.978134:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264362.978250:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311254912 00000100:00100000:2.0:1789264362.978260:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311254912 00000100:00100000:2.0:1789264362.978319:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 146 00000100:00100000:2.0:1789264362.978329:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+12:14895:x1876179311254912:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789264362.978343:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264362.978361:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3983e45800/0xecaf9f2f14ed8275 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf4c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264362.978386:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e45800/0xecaf9f2f14ed8275 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf4c expref: 13 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264362.978397:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3983e45800/0xecaf9f2f14ed8275 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf4c expref: 13 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264362.978405:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45800, rc 0) 00000100:00100000:2.0:1789264362.978466:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:14895:x1876179311254912:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 139us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264362.978473:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 146 00000100:00100000:1.0:1789264362.981064:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264362.981140:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311255040 00000100:00100000:3.0:1789264362.981163:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311255040 00000100:00100000:3.0:1789264362.981213:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 147 00000100:00100000:3.0:1789264362.981222:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:14895:x1876179311255040:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264362.981357:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:14895:x1876179311255040:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 135us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264362.981365:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 147 00000100:00100000:3.0:1789264362.983875:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264362.984126:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311255168 00000100:00100000:1.0:1789264362.984137:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311255168 00000100:00100000:1.0:1789264362.984191:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 148 00000100:00100000:1.0:1789264362.984200:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:14895:x1876179311255168:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789264362.984338:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:14895:x1876179311255168:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 Request processed in 137us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264362.984346:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 148 00000100:00100000:3.0:1789264363.018936:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39845ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322845696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789264363.019003:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264363.020311:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322845696 00000100:00100000:3.0:1789264363.020324:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322845696 00000100:00100000:3.0:1789264363.020898:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789264363.020910:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322845696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789264363.020935:0:18712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789264363.021018:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322845696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264363.021026:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789264363.021115:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39845ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322845696:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1789264363.083453:0:17201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789264363.083462:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3984743000 from 13 10000000:01000000:3.0:1789264363.083467:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789264363.083515:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a813fd400/0xecaf9f2f14ed827c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264363.083527:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c3a813fd400/0xecaf9f2f14ed827c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264363.083540:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c3a813fd400/0xecaf9f2f14ed827c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264363.083584:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322845824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789264363.083658:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264363.083707:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3983c529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264363.083776:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322845824 00000100:00100000:0.0:1789264363.083784:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322845824 00000100:00100000:0.0:1789264363.083832:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789264363.083840:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+20:17201:x1876179322845824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264363.083853:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264363.083865:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c398366a200/0xecaf9f2f14ed8283 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed827c expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.083888:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c398366a200/0xecaf9f2f14ed8283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed827c expref: 21 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.083910:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c398366a200/0xecaf9f2f14ed8283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed827c expref: 21 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.083920:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366a200, rc 0) 00000100:00100000:0.0:1789264363.083964:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:17201:x1876179322845824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264363.083971:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789264363.084014:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322845824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264363.084027:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c3a813fd400/0xecaf9f2f14ed827c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed8283 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.084036:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c3a813fd400/0xecaf9f2f14ed827c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed8283 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264363.084092:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322845952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.084119:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264363.084136:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa76ebf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789264363.084353:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322845952 00000100:00100000:3.0:1789264363.084357:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322845952 00000100:00100000:3.0:1789264363.084464:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789264363.084473:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:17201:x1876179322845952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789264363.084585:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:17201:x1876179322845952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264363.084592:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789264363.085493:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322845952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.085537:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.085592:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264363.085636:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa76ebf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789264363.086316:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322846080 00000100:00100000:3.0:1789264363.086324:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322846080 00000100:00100000:3.0:1789264363.086488:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789264363.086500:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:17201:x1876179322846080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789264363.086624:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:17201:x1876179322846080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264363.086631:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789264363.086793:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789264363.089659:0:20321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789264363.089845:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789264363.089869:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789264363.089889:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c3a813fd400/0xecaf9f2f14ed827c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed8283 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.089901:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c3a813fd400/0xecaf9f2f14ed827c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed8283 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264363.089912:0:17201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789264363.089915:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3abb9e8800 from 13 10000000:01000000:0.0:1789264363.089918:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789264363.089952:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed828a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.089960:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed828a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.089973:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed828a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264363.089997:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.090063:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264363.090100:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa76ebf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789264363.090206:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322846208 00000100:00100000:3.0:1789264363.090214:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322846208 00000100:00100000:3.0:1789264363.090257:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789264363.090265:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+21:17201:x1876179322846208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789264363.090457:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264363.090470:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3a813fd200/0xecaf9f2f14ed8291 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed828a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264363.090503:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3a813fd200/0xecaf9f2f14ed8291 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed828a expref: 22 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264363.090513:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3a813fd200/0xecaf9f2f14ed8291 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed828a expref: 22 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264363.090521:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a813fd200, rc 0) 00000100:00100000:3.0:1789264363.090558:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:17201:x1876179322846208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264363.090564:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789264363.090661:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264363.090675:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed828a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed8291 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.090684:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed828a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed8291 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264363.090775:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.090811:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264363.090826:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa76ebf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264363.090841:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322846336 00000100:00100000:0.0:1789264363.090844:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322846336 00000100:00100000:0.0:1789264363.090871:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789264363.090877:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:17201:x1876179322846336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.090988:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:17201:x1876179322846336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264363.090995:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789264363.091026:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.091051:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.091090:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264363.091103:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa76ebf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789264363.091113:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322846464 00000100:00100000:0.0:1789264363.091116:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322846464 00000100:00100000:0.0:1789264363.091135:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789264363.091141:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:17201:x1876179322846464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.091224:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:17201:x1876179322846464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264363.091230:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789264363.092628:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789264363.096495:0:20322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789264363.096688:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789264363.096710:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789264363.096722:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed828a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed8291 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.096790:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c398366a800/0xecaf9f2f14ed828a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed8291 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264363.096800:0:17201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789264363.096802:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c39835f3800 from 13 10000000:01000000:0.0:1789264363.096805:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789264363.096838:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366ac00/0xecaf9f2f14ed8298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.096845:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c398366ac00/0xecaf9f2f14ed8298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.096856:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c398366ac00/0xecaf9f2f14ed8298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264363.096880:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.096944:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264363.096986:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa76ebf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789264363.097070:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322846592 00000100:00100000:2.0:1789264363.097078:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322846592 00000100:00100000:2.0:1789264363.097119:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789264363.097129:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+22:17201:x1876179322846592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789264363.097151:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264363.097163:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed829f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed8298 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264363.097186:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed829f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed8298 expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264363.097208:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c3983e45200/0xecaf9f2f14ed829f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed8298 expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264363.097217:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45200, rc 0) 00000100:00100000:2.0:1789264363.097256:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:17201:x1876179322846592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264363.097262:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789264363.097315:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789264363.097328:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c398366ac00/0xecaf9f2f14ed8298 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed829f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264363.097337:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c398366ac00/0xecaf9f2f14ed8298 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed829f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264363.097586:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983113480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789264363.097625:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264363.097650:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a9649c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264363.097664:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322846720 00000100:00100000:2.0:1789264363.097668:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322846720 00000100:00100000:2.0:1789264363.097695:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789264363.097702:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:17201:x1876179322846720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789264363.097841:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:17201:x1876179322846720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264363.097848:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789264363.097879:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983113480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789264363.097909:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983113480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789264363.097948:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264363.097965:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a9649c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789264363.097976:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322846848 00000100:00100000:2.0:1789264363.097980:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322846848 00000100:00100000:2.0:1789264363.098000:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789264363.098006:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983cbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:17201:x1876179322846848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789264363.098075:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983cbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:17201:x1876179322846848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264363.098081:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789264363.098121:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983113480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789264363.099155:0:20323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789264363.105097:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789264363.105134:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789264363.105144:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366ac00/0xecaf9f2f14ed8298 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed829f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.105157:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c398366ac00/0xecaf9f2f14ed8298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed829f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789264363.105167:0:17201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789264363.105170:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c3983f5f000 from 13 10000000:01000000:0.0:1789264363.105172:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789264363.105221:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366be00/0xecaf9f2f14ed82a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.105229:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff9c398366be00/0xecaf9f2f14ed82a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.105239:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff9c398366be00/0xecaf9f2f14ed82a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264363.105260:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.105412:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264363.105450:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa76eb180 going to sleep for 11 seconds 00000100:00100000:0.0:1789264363.105471:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322846976 00000100:00100000:0.0:1789264363.105477:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322846976 00000100:00100000:0.0:1789264363.105517:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789264363.105527:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a907c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+23:17201:x1876179322846976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264363.105540:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264363.105551:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c398366b800/0xecaf9f2f14ed82ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xecaf9f2f14ed82a6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.105573:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c398366b800/0xecaf9f2f14ed82ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xecaf9f2f14ed82a6 expref: 24 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.105583:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c398366b800/0xecaf9f2f14ed82ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xecaf9f2f14ed82a6 expref: 24 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.105591:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366b800, rc 0) 00000100:00100000:0.0:1789264363.105639:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a907c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:17201:x1876179322846976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264363.105645:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789264363.105698:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322846976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789264363.105711:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff9c398366be00/0xecaf9f2f14ed82a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed82ad expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.105719:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff9c398366be00/0xecaf9f2f14ed82a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xecaf9f2f14ed82ad expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264363.105800:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322847104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.105822:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264363.105835:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa76eb180 going to sleep for 11 seconds 00000100:00100000:0.0:1789264363.105859:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322847104 00000100:00100000:0.0:1789264363.105862:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322847104 00000100:00100000:0.0:1789264363.105883:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789264363.105889:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a907c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:17201:x1876179322847104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.105984:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a907c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:17201:x1876179322847104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264363.105991:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789264363.106020:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322847104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.106046:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad81500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322847232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.106085:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789264363.106099:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa76eb180 going to sleep for 11 seconds 00000100:00100000:0.0:1789264363.106111:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322847232 00000100:00100000:0.0:1789264363.106114:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322847232 00000100:00100000:0.0:1789264363.106134:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789264363.106139:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:17201:x1876179322847232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789264363.106223:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:17201:x1876179322847232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264363.106235:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789264363.106289:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad81500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:17201:1876179322847232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789264363.106988:0:20327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789264363.107042:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789264363.107057:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789264363.107064:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9c398366be00/0xecaf9f2f14ed82a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed82ad expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264363.107074:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff9c398366be00/0xecaf9f2f14ed82a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xecaf9f2f14ed82ad expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264363.402064:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264364.042112:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789264364.042134:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322847360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789264364.042203:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264364.042279:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322847360 00000100:00100000:1.0:1789264364.042287:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322847360 00000100:00100000:1.0:1789264364.042332:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789264364.042340:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322847360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789264364.042371:0:17208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789264364.042423:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876179322847360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264364.042430:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789264364.042478:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1876179322847360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789264364.043578:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789264364.043612:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322847488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789264364.043658:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264364.043766:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322847488 00000100:00100000:1.0:1789264364.043772:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322847488 00000100:00100000:1.0:1789264364.043871:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789264364.043881:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322847488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789264364.043908:0:17208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789264364.043963:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322847488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264364.043970:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789264364.044047:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322847488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789264364.179667:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264364.180016:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311255296 00000100:00100000:2.0:1789264364.180027:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311255296 00000100:00080000:0.0:1789264364.180100:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264364.180115:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:2.0:1789264364.180139:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+6:15564:x1876179311255296:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789264364.180159:0:18643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264364.180178:0:18643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed82b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf53 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180248:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180262:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180277:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180292:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed82c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180299:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed82c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180306:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed82c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180384:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed82c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180392:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed82c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180400:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed82c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264364.180440:0:18643:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789264364.180443:0:18643:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264364.180482:0:18643:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed82c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180492:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180498:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180504:0:18643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180509:0:18643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264364.180513:0:18643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180520:0:18643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180531:0:18643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983361200) 00010000:00010000:2.0:1789264364.180534:0:18643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264364.180538:0:18643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180543:0:18643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180555:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed82c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180570:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed82c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180575:0:18643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed82c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180579:0:18643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264364.180582:0:18643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed82c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180599:0:18643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed82c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180607:0:18643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c3ab7e78a00) 00010000:00010000:2.0:1789264364.180609:0:18643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264364.180612:0:18643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed82c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180617:0:18643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed82c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180650:0:18643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed82b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf53 expref: 8 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180662:0:18643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44a00/0xecaf9f2f14ed82c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf53 expref: 7 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.180670:0:18643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c3ab7e78600) 00010000:00010000:2.0:1789264364.180672:0:18643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789264364.180681:0:18643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44a00, rc 0) 00000100:00100000:2.0:1789264364.181357:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+7:15564:x1876179311255296:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1215us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264364.181366:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:2.0:1789264364.185633:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.185708:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311255424 00000100:00100000:3.0:1789264364.185720:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311255424 00000100:00100000:3.0:1789264364.186728:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:3.0:1789264364.186757:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd292616-4ff1-43bd-9855-5a9de2560302+7:15564:x1876179311255424:12345-192.168.203.44@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789264364.186857:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd292616-4ff1-43bd-9855-5a9de2560302+7:15564:x1876179311255424:12345-192.168.203.44@tcp:900:lhsmtool_posix.0 Request processed in 117us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264364.186865:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:1.0:1789264364.189369:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264364.189518:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311255680 00000100:00100000:2.0:1789264364.189530:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311255680 00000100:00100000:2.0:1789264364.189587:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:2.0:1789264364.189606:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39845ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+7:15564:x1876179311255680:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789264364.189625:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264364.189646:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed82d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf5a expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.189723:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82d7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.189738:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.189776:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.189793:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed82de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.189802:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed82de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.189809:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed82de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.189939:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed82e5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.189948:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed82e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.189955:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed82e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264364.189964:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789264364.190113:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.190121:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82d7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.190127:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.190134:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e44600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264364.190138:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.190146:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82d7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.190159:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c3ab7e78600) 00010000:00010000:2.0:1789264364.190162:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264364.190166:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.190181:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed82d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.190207:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed82de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.190213:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed82de lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.190218:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed82de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.190223:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45a00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264364.190226:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed82de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.190232:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed82de lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.190240:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c3ab7e78a00) 00010000:00010000:2.0:1789264364.190243:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264364.190246:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed82de lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.190252:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed82de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.191135:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed82d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf5a expref: 10 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.191172:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44c00/0xecaf9f2f14ed82e5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf5a expref: 9 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.191190:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e78400) 00010000:00010000:2.0:1789264364.191193:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264364.191196:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44c00, rc 0) 00000100:00100000:2.0:1789264364.191271:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39845ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+9:15564:x1876179311255680:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1667us (1923us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789264364.191280:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:2.0:1789264364.207903:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.207993:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311255808 00000100:00100000:3.0:1789264364.208002:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311255808 00000100:00100000:3.0:1789264364.208062:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:3.0:1789264364.208073:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+9:15564:x1876179311255808:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789264364.208225:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+9:15564:x1876179311255808:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 Request processed in 152us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264364.208260:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:3.0:1789264364.219203:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264364.221302:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311255936 00000100:00100000:2.0:1789264364.221317:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311255936 00000100:00100000:2.0:1789264364.221459:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:2.0:1789264364.221471:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+5:15564:x1876179311255936:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789264364.224254:0:17205:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2743us 00000100:00080000:0.0:1789264364.224383:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789264364.244717:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+5:15564:x1876179311255936:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 Request processed in 23240us (25514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264364.244731:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:1.0:1789264364.255097:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.255220:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311256064 00000100:00100000:3.0:1789264364.255229:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311256064 00000100:00100000:3.0:1789264364.255284:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:3.0:1789264364.255293:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+9:15570:x1876179311256064:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1789264364.255311:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264364.255329:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed82f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf61 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255383:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed82fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255396:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed82fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255406:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed82fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255419:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8301 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255425:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255430:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255486:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed82fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255492:0:17203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed82fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255498:0:17203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed82fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255504:0:17203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fc800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264364.255507:0:17203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed82fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255513:0:17203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed82fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255524:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983361200) 00010000:00010000:3.0:1789264364.255526:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264364.255530:0:17203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed82fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255535:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed82fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255547:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255552:0:17203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8301 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255558:0:17203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8301 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255568:0:17203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fc400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264364.255571:0:17203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8301 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255576:0:17203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8301 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255585:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c398335fd00) 00010000:00010000:3.0:1789264364.255603:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264364.255606:0:17203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8301 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255611:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8301 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255646:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed82f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf61 expref: 10 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255656:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983361200) 00010000:00010000:3.0:1789264364.255658:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264364.255661:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed82f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf61 expref: 10 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.255670:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a813fc600, rc 0) 00000100:00100000:3.0:1789264364.255734:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+9:15570:x1876179311256064:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 441us (646us total) trans 0 rc 301/301 00000100:00100000:3.0:1789264364.255788:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:3.0:1789264364.261718:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264364.262300:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311256192 00000100:00100000:2.0:1789264364.262311:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311256192 00000100:00100000:2.0:1789264364.262375:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:2.0:1789264364.262386:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dd292616-4ff1-43bd-9855-5a9de2560302+9:15570:x1876179311256192:12345-192.168.203.44@tcp:700:lfs.0 00000100:00100000:2.0:1789264364.262475:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dd292616-4ff1-43bd-9855-5a9de2560302+9:15570:x1876179311256192:12345-192.168.203.44@tcp:700:lfs.0 Request processed in 91us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264364.262483:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:0.0:1789264364.270564:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264364.270651:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311256448 00000100:00100000:1.0:1789264364.270661:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311256448 00000100:00100000:1.0:1789264364.270723:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:1.0:1789264364.270734:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+9:15570:x1876179311256448:12345-192.168.203.44@tcp:36:lfs.0 00010000:00010000:1.0:1789264364.270814:0:17204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264364.270844:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed8221 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaece expref: 9 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.270864:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983361200) 00010000:00010000:1.0:1789264364.270869:0:17204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789264364.270927:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.270941:0:17204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed8260 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf3e expref: 5 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.270967:0:17204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.271001:0:17204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed8260 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf3e expref: 5 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.271015:0:17204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed8260 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf3e expref: 5 pid: 17203 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264364.271030:0:17204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17204:1876179322847616:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264364.271106:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae36fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789264364.282160:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.282289:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311256576 00000100:00100000:3.0:1789264364.282296:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311256576 00000100:00100000:2.0:1789264364.282302:0:17204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17204:1876179322847616:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264364.282328:0:17204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.282349:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed8260 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf3e expref: 6 pid: 17203 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264364.282385:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:3.0:1789264364.282394:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3542bc01-ba46-418a-baf3-94035bd58f4f+6:2402:x1876179311256576:12345-192.168.203.44@tcp:103:ldlm_bl.0 00000100:00080000:0.0:1789264364.282403:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789264364.282409:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264364.282415:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed8260 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf3e expref: 6 pid: 17203 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.282427:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed8260 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf3e expref: 6 pid: 17203 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.282450:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed8260 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf3e expref: 6 pid: 17203 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.282465:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983361200) 00010000:00010000:3.0:1789264364.282470:0:17190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.282479:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.282486:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.282517:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264364.282571:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3542bc01-ba46-418a-baf3-94035bd58f4f+5:2402:x1876179311256576:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 179us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264364.282601:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 15 00010000:00010000:1.0:1789264364.282654:0:17204:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.282661:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.282681:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed830f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.282690:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed830f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.282698:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed830f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.284855:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ffa00/0xecaf9f2f14ed8316 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.284882:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ffa00/0xecaf9f2f14ed8316 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.284893:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ffa00/0xecaf9f2f14ed8316 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789264364.284911:0:17204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088f597c1 reply state 00000000f3840753 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ffa00/0xecaf9f2f14ed8316 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.284922:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ffa00/0xecaf9f2f14ed8316 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.284929:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c3a8c3bec00) 00010000:00010000:1.0:1789264364.284932:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789264364.284935:0:17204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789264364.284941:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789264364.284950:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.284956:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.284963:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.284969:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fea00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264364.284974:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.284981:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.285002:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3983361200) 00010000:00010000:1.0:1789264364.285005:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789264364.285009:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.285015:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8308 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789264364.285035:0:17204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088f597c1 reply state 00000000f3840753 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed830f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.285044:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed830f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.285050:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c3a8c3bed00) 00010000:00010000:1.0:1789264364.285053:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789264364.285055:0:17204:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789264364.285143:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+10:15570:x1876179311256448:12345-192.168.203.44@tcp:36:lfs.0 Request processed in 14407us (14585us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789264364.285152:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:1.0:1789264364.361391:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264364.361980:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311256704 00000100:00100000:2.0:1789264364.361990:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311256704 00000100:00100000:2.0:1789264364.362044:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:2.0:1789264364.362053:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+10:15578:x1876179311256704:12345-192.168.203.44@tcp:101:lctl.0 00010000:00010000:2.0:1789264364.362075:0:18643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264364.362094:0:18643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed831d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf68 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.362149:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed8324 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.362161:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed8324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.362171:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed8324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264364.362206:0:18643:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789264364.362209:0:18643:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264364.362251:0:18643:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed8324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.362272:0:18643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed831d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf68 expref: 12 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.362288:0:18643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45a00/0xecaf9f2f14ed8324 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf68 expref: 11 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.362308:0:18643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e78a00) 00010000:00010000:2.0:1789264364.362311:0:18643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789264364.362314:0:18643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e45a00, rc 0) 00000100:00100000:2.0:1789264364.362421:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+11:15578:x1876179311256704:12345-192.168.203.44@tcp:101:lctl.0 Request processed in 368us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264364.362427:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:3.0:1789264364.387231:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264364.388996:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311256832 00000100:00100000:2.0:1789264364.389011:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311256832 00000100:00100000:2.0:1789264364.389261:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:2.0:1789264364.389273:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3542bc01-ba46-418a-baf3-94035bd58f4f+5:15579:x1876179311256832:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264364.389293:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264364.389326:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed832b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf6f expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.389388:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed8332 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.389402:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed8332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.389413:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed8332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264364.389454:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789264364.389458:0:17205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264364.389479:0:17205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed8332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.389521:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed832b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf6f expref: 7 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.389539:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44600/0xecaf9f2f14ed8332 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf6f expref: 6 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.389548:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e78a00) 00010000:00010000:2.0:1789264364.389550:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789264364.389554:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3983e44600, rc 0) 00000100:00100000:2.0:1789264364.389643:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3542bc01-ba46-418a-baf3-94035bd58f4f+6:15579:x1876179311256832:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 373us (2420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264364.389650:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:0.0:1789264364.392688:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264364.396447:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311256960 00000100:00100000:1.0:1789264364.396464:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311256960 00000100:00100000:1.0:1789264364.396596:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:1.0:1789264364.396617:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3542bc01-ba46-418a-baf3-94035bd58f4f+6:15579:x1876179311256960:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1789264364.396707:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264364.396735:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8339 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf76 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.396843:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff000/0xecaf9f2f14ed8340 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.396859:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff000/0xecaf9f2f14ed8340 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.396872:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff000/0xecaf9f2f14ed8340 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.396883:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8347 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.396893:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.396900:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.396988:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed834e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.396997:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed834e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397003:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed834e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789264364.397040:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789264364.397043:0:17204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789264364.397061:0:17204:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed834e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397084:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff000/0xecaf9f2f14ed8340 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397090:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff000/0xecaf9f2f14ed8340 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397096:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff000/0xecaf9f2f14ed8340 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397101:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9ff000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264364.397105:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff000/0xecaf9f2f14ed8340 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397112:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff000/0xecaf9f2f14ed8340 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397126:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e78a00) 00010000:00010000:1.0:1789264364.397129:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789264364.397134:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff000/0xecaf9f2f14ed8340 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397140:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff000/0xecaf9f2f14ed8340 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397153:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397160:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8347 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397165:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8347 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397177:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9ff800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:1.0:1789264364.397180:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8347 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397186:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8347 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397195:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c3a8c3bed00) 00010000:00010000:1.0:1789264364.397198:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789264364.397201:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8347 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397208:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8347 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397235:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fea00/0xecaf9f2f14ed8339 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf76 expref: 8 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397451:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed834e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf76 expref: 7 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.397459:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c3a8c3bec00) 00010000:00010000:1.0:1789264364.397462:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789264364.397465:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abb9ff400, rc 0) 00000100:00100000:1.0:1789264364.397536:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3542bc01-ba46-418a-baf3-94035bd58f4f+7:15579:x1876179311256960:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 924us (4856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264364.397544:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:3.0:1789264364.406443:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264364.406650:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311257088 00000100:00100000:1.0:1789264364.406673:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311257088 00000100:00080000:0.0:1789264364.406926:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789264364.406973:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:1.0:1789264364.406987:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3542bc01-ba46-418a-baf3-94035bd58f4f+5:15579:x1876179311257088:12345-192.168.203.44@tcp:900:lfs.0 00000100:00100000:1.0:1789264364.407074:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3542bc01-ba46-418a-baf3-94035bd58f4f+5:15579:x1876179311257088:12345-192.168.203.44@tcp:900:lfs.0 Request processed in 90us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264364.407082:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:0.0:1789264364.409403:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.409490:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311257344 00000100:00100000:3.0:1789264364.409499:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311257344 00000100:00100000:3.0:1789264364.409558:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 32 00000100:00100000:3.0:1789264364.409568:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+7:15579:x1876179311257344:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1789264364.409596:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264364.409615:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed8355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf7d expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264364.409720:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789264364.409845:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed8355 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf7d expref: 9 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.409859:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e78a00) 00010000:00010000:3.0:1789264364.409862:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789264364.409867:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed8355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf7d expref: 9 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.409881:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a813fc600, rc 0) 00000100:00100000:3.0:1789264364.409937:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+8:15579:x1876179311257344:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 370us (542us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1789264364.409944:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 32 00000100:00100000:0.0:1789264364.413163:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264364.413346:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311257600 00000100:00100000:1.0:1789264364.413355:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311257600 00000100:00100000:1.0:1789264364.413418:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:1.0:1789264364.413429:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3542bc01-ba46-418a-baf3-94035bd58f4f+8:15579:x1876179311257600:12345-192.168.203.44@tcp:36:lfs.0 00010000:00010000:1.0:1789264364.413486:0:17204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264364.413513:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed834e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf76 expref: 8 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.413532:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c3a8c3bec00) 00010000:00010000:1.0:1789264364.413536:0:17204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789264364.413559:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8363 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.413573:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8363 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.413583:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8363 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789264364.415162:0:17204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088d584f8 reply state 00000000c8daf514 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8363 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264364.415185:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8363 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264364.415195:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c3a8c3bec00) 00010000:00010000:0.0:1789264364.415198:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1789264364.415202:0:17204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789264364.415233:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789264364.415476:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3542bc01-ba46-418a-baf3-94035bd58f4f+9:15579:x1876179311257600:12345-192.168.203.44@tcp:36:lfs.0 Request processed in 2046us (2318us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789264364.415485:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:1.0:1789264364.417947:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.418026:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311257856 00000100:00100000:3.0:1789264364.418035:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311257856 00000100:00100000:3.0:1789264364.418174:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:3.0:1789264364.418196:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+9:15579:x1876179311257856:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:3.0:1789264364.418436:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+10:15579:x1876179311257856:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 252us (500us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789264364.418443:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:0.0:1789264364.423822:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.423851:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311258112 00000100:00100000:3.0:1789264364.423859:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311258112 00000100:00100000:3.0:1789264364.423985:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:3.0:1789264364.423994:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+10:15579:x1876179311258112:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1789264364.424018:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264364.424038:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed836a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf84 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424122:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8371 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424136:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8371 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424147:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8371 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424158:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed8378 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424164:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed8378 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424170:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed8378 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264364.424295:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789264364.424383:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8371 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424390:0:17203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8371 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424397:0:17203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8371 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424403:0:17203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fc400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264364.424407:0:17203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8371 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424415:0:17203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8371 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424426:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e78a00) 00010000:00010000:3.0:1789264364.424429:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264364.424434:0:17203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8371 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424440:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8371 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424451:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed8378 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424457:0:17203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed8378 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424473:0:17203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed8378 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424478:0:17203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fc800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264364.424481:0:17203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed8378 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424487:0:17203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed8378 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424496:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c3a8c3bed00) 00010000:00010000:3.0:1789264364.424498:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264364.424501:0:17203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed8378 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424507:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed8378 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424541:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed836a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf84 expref: 12 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424551:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e78a00) 00010000:00010000:3.0:1789264364.424553:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789264364.424557:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed836a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf84 expref: 12 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.424566:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a813fc600, rc 0) 00000100:00100000:3.0:1789264364.424636:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+11:15579:x1876179311258112:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 642us (822us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789264364.424652:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 34 00010000:00010000:2.0:1789264364.426572:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264364.427403:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.427478:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311258240 00000100:00100000:3.0:1789264364.427487:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311258240 00000100:00100000:3.0:1789264364.427544:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:3.0:1789264364.427555:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3542bc01-ba46-418a-baf3-94035bd58f4f+11:15579:x1876179311258240:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1789264364.427579:0:18643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264364.427606:0:18643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8386 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf8b expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.427697:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed838d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.427717:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed838d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.427729:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed838d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264364.427783:0:18643:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789264364.427787:0:18643:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264364.427804:0:18643:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed838d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.427828:0:18643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8386 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf8b expref: 13 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.427858:0:18643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed838d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf8b expref: 12 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.427884:0:18643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c3a8c3bec00) 00010000:00010000:3.0:1789264364.427887:0:18643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789264364.427890:0:18643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a813fc000, rc 0) 00000100:00100000:3.0:1789264364.427946:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3542bc01-ba46-418a-baf3-94035bd58f4f+12:15579:x1876179311258240:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 392us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264364.427953:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:1.0:1789264364.433638:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264364.434524:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311258368 00000100:00100000:2.0:1789264364.434535:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311258368 00000100:00100000:2.0:1789264364.434607:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:2.0:1789264364.434618:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3542bc01-ba46-418a-baf3-94035bd58f4f+12:15579:x1876179311258368:12345-192.168.203.44@tcp:37:lfs.0 00000100:00100000:2.0:1789264364.440409:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3542bc01-ba46-418a-baf3-94035bd58f4f+12:15579:x1876179311258368:12345-192.168.203.44@tcp:37:lfs.0 Request processed in 5783us (6773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264364.440422:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:0.0:1789264364.444049:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.445532:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311258624 00000100:00100000:3.0:1789264364.445548:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311258624 00000100:00100000:3.0:1789264364.445623:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:3.0:1789264364.445634:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+12:15579:x1876179311258624:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:3.0:1789264364.445875:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+13:15579:x1876179311258624:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 243us (1837us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789264364.445882:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:1.0:1789264364.489097:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264364.489503:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311258752 00000100:00100000:2.0:1789264364.489513:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311258752 00000100:00100000:2.0:1789264364.489574:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:2.0:1789264364.489599:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+11:15585:x1876179311258752:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1789264364.489618:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264364.489647:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed8394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf92 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.489713:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed839b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.489725:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed839b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.489736:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed839b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.489794:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.489803:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.489882:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.489968:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed83a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.489981:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed83a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.489988:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed83a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264364.490020:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789264364.490024:0:17205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789264364.490060:0:17205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed83a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490079:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed839b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490084:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed839b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490372:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed839b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490378:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3983e45400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264364.490382:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed839b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490390:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed839b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490402:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e78a00) 00010000:00010000:2.0:1789264364.490405:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264364.490410:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed839b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490416:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e45400/0xecaf9f2f14ed839b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490429:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490436:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490442:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490453:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1dc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264364.490456:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490463:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490471:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c3a8c3bed00) 00010000:00010000:2.0:1789264364.490474:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264364.490477:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490483:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490510:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3983e44200/0xecaf9f2f14ed8394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf92 expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490523:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c600/0xecaf9f2f14ed83a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf92 expref: 12 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.490530:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c3a8c3bec00) 00010000:00010000:2.0:1789264364.490533:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789264364.490535:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c600, rc 0) 00000100:00100000:2.0:1789264364.490968:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+12:15585:x1876179311258752:12345-192.168.203.44@tcp:101:bash.0 Request processed in 1377us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264364.490977:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:1.0:1789264364.493516:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.493635:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311258880 00000100:00100000:3.0:1789264364.493644:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311258880 00000100:00100000:3.0:1789264364.493703:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:3.0:1789264364.493717:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dd292616-4ff1-43bd-9855-5a9de2560302+5:15585:x1876179311258880:12345-192.168.203.44@tcp:900:bash.0 00000100:00100000:3.0:1789264364.493838:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dd292616-4ff1-43bd-9855-5a9de2560302+5:15585:x1876179311258880:12345-192.168.203.44@tcp:900:bash.0 Request processed in 126us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264364.493846:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:0.0:1789264364.495559:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.495662:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311259136 00000100:00100000:3.0:1789264364.495669:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311259136 00000100:00100000:3.0:1789264364.495774:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 37 00000100:00100000:3.0:1789264364.495784:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+12:15585:x1876179311259136:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1789264364.495814:0:18643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264364.495832:0:18643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed83b0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaf99 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.495930:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.495943:0:18643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed838d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf8b expref: 12 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.495951:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.495980:0:18643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed838d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf8b expref: 12 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.495993:0:18643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed838d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf8b expref: 12 pid: 18643 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264364.496005:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18643:1876179322847744:192.168.203.44@tcp:104: 00000100:00100000:3.0:1789264364.496076:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3ab2dc7480 going to sleep for 11 seconds 00000100:00100000:3.0:1789264364.499041:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18643:1876179322847744:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264364.499070:0:18643:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264364.499642:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264364.499724:0:18356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311259264 00000100:00100000:1.0:1789264364.499731:0:18356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311259264 00010000:00010000:1.0:1789264364.499820:0:18356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed838d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf8b expref: 13 pid: 18643 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264364.499856:0:18356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:1.0:1789264364.499866:0:18356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3542bc01-ba46-418a-baf3-94035bd58f4f+13:2402:x1876179311259264:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264364.499881:0:18356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264364.499888:0:18356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed838d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf8b expref: 13 pid: 18643 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.499902:0:18356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed838d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf8b expref: 13 pid: 18643 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.499923:0:18356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed838d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf8b expref: 13 pid: 18643 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.499940:0:18356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c3a8c3bec00) 00010000:00010000:1.0:1789264364.499944:0:18356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.499953:0:18356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.499961:0:18356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.499982:0:18356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264364.500071:0:18356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3542bc01-ba46-418a-baf3-94035bd58f4f+12:2402:x1876179311259264:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 206us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264364.500102:0:18356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 16 00010000:00010000:3.0:1789264364.500328:0:18643:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.500337:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.500375:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed83be lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.500385:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed83be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.500392:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed83be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.500879:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed83c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.500889:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed83c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.500897:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed83c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264364.500908:0:18643:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789264364.500933:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.500939:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.500946:0:18643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.500951:0:18643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fc600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264364.500955:0:18643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.500974:0:18643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.500984:0:18643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c3a8c3bec00) 00010000:00010000:3.0:1789264364.500987:0:18643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264364.500991:0:18643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.500997:0:18643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83b7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789264364.501010:0:18643:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f26d44a reply state 0000000000c97e90 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed83be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.501020:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed83be lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.501026:0:18643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c398335fd00) 00010000:00010000:3.0:1789264364.501028:0:18643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789264364.501031:0:18643:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789264364.501063:0:18643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed83b0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf99 expref: 15 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.501077:0:18643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed83c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf99 expref: 14 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.501084:0:18643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:3.0:1789264364.501276:0:18643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789264364.501280:0:18643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a813fc400, rc 0) 00000100:00100000:3.0:1789264364.501332:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+15:15585:x1876179311259136:12345-192.168.203.44@tcp:101:bash.0 Request processed in 5546us (5775us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789264364.501339:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 37 00000100:00100000:1.0:1789264364.512504:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.512619:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311259392 00000100:00100000:3.0:1789264364.512630:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311259392 00000100:00100000:3.0:1789264364.512790:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 38 00000100:00100000:3.0:1789264364.512801:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+15:15585:x1876179311259392:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1789264364.512825:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264364.512913:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed83d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdafa0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.512981:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.512994:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.513016:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264364.513061:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789264364.513065:0:17203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264364.513081:0:17203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.513091:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.513114:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed83d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafa0 expref: 17 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.513154:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafa0 expref: 16 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.513163:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:3.0:1789264364.513166:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789264364.513169:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a813fc600, rc 0) 00000100:00100000:3.0:1789264364.513218:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+16:15585:x1876179311259392:12345-192.168.203.44@tcp:101:bash.0 Request processed in 419us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264364.513224:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 38 00000100:00100000:0.0:1789264364.517025:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.517078:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311259648 00000100:00100000:3.0:1789264364.517089:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311259648 00000100:00100000:3.0:1789264364.517277:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:3.0:1789264364.517288:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd292616-4ff1-43bd-9855-5a9de2560302+16:15585:x1876179311259648:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:3.0:1789264364.517577:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd292616-4ff1-43bd-9855-5a9de2560302+17:15585:x1876179311259648:12345-192.168.203.44@tcp:35:bash.0 Request processed in 290us (561us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789264364.517584:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:3.0:1789264364.602485:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264364.602625:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311259904 00000100:00100000:2.0:1789264364.602661:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311259904 00000100:00100000:2.0:1789264364.602719:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:2.0:1789264364.602730:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+17:15595:x1876179311259904:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264364.602787:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264364.602808:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdafa7 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264364.602992:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789264364.603102:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafa7 expref: 19 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.603121:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c3ab7e78a00) 00010000:00010000:2.0:1789264364.603124:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789264364.603130:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafa7 expref: 19 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.603143:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1dc00, rc 0) 00000100:00100000:2.0:1789264364.603534:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+18:15595:x1876179311259904:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 804us (1059us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789264364.603543:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:1.0:1789264364.606549:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264364.606645:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311260160 00000100:00100000:2.0:1789264364.606654:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311260160 00000100:00100000:2.0:1789264364.606706:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:2.0:1789264364.606715:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd292616-4ff1-43bd-9855-5a9de2560302+18:15595:x1876179311260160:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:2.0:1789264364.606951:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd292616-4ff1-43bd-9855-5a9de2560302+19:15595:x1876179311260160:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 237us (410us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789264364.606958:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:0.0:1789264364.638306:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264364.638550:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311260416 00000100:00100000:2.0:1789264364.638561:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311260416 00000100:00100000:2.0:1789264364.638632:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:2.0:1789264364.638643:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+19:15598:x1876179311260416:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1789264364.638668:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264364.638692:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdafae expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.638840:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed83f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.638854:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed83f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.638867:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed83f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264364.638879:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789264364.638982:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed83ef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafae expref: 22 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.639001:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed83f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafae expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.639010:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:2.0:1789264364.639013:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789264364.639017:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1d000, rc 0) 00000100:00100000:2.0:1789264364.639082:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+21:15598:x1876179311260416:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 440us (812us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789264364.639107:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:0.0:1789264364.642883:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.644696:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311260544 00000100:00100000:3.0:1789264364.644711:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311260544 00000100:00100000:0.0:1789264364.645231:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264364.645315:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311260672 00000100:00100000:1.0:1789264364.645320:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311260672 00000100:00100000:1.0:1789264364.645377:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:1.0:1789264364.645387:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd292616-4ff1-43bd-9855-5a9de2560302+22:2403:x1876179311260672:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264364.645402:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264364.645425:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed83f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafae expref: 22 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264364.645443:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:1.0:1789264364.645447:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264364.645500:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd292616-4ff1-43bd-9855-5a9de2560302+21:2403:x1876179311260672:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 114us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264364.645507:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:3.0:1789264364.646567:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:3.0:1789264364.646582:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+20:15598:x1876179311260544:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:3.0:1789264364.646654:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8404 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.646670:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8404 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.646696:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8404 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.646731:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8404 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.646739:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8404 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.646772:0:18643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8404 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.646778:0:18643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fcc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264364.646782:0:18643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8404 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.646790:0:18643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8404 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.646801:0:18643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:3.0:1789264364.646803:0:18643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789264364.646807:0:18643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8404 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.646814:0:18643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8404 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264364.646872:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+20:15598:x1876179311260544:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 295us (3999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264364.646879:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:0.0:1789264364.649690:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264364.649959:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311260928 00000100:00100000:2.0:1789264364.649970:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311260928 00000100:00100000:2.0:1789264364.650048:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:2.0:1789264364.650058:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd292616-4ff1-43bd-9855-5a9de2560302+20:15598:x1876179311260928:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:2.0:1789264364.650530:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd292616-4ff1-43bd-9855-5a9de2560302+21:15598:x1876179311260928:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 472us (848us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789264364.650539:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00000040:00080000:3.0:1789264364.684292:0:17239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789264364.874677:0:17956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789264364.900521:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264364.900823:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311261184 00000100:00100000:2.0:1789264364.900837:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311261184 00000100:00100000:2.0:1789264364.900900:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:2.0:1789264364.900911:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+21:15629:x1876179311261184:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:2.0:1789264364.900940:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264364.900978:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed840b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdafb5 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.901098:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8412 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.901121:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8412 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.901142:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8412 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789264364.901160:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789264364.901353:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed840b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafb5 expref: 24 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.901397:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8412 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafb5 expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.901408:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:2.0:1789264364.901414:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789264364.901419:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c200, rc 0) 00000100:00100000:2.0:1789264364.901501:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+23:15629:x1876179311261184:12345-192.168.203.44@tcp:101:cat.0 Request processed in 591us (988us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789264364.901513:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:0.0:1789264364.914072:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264364.914130:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264364.914315:0:20232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311261312 00000100:00100000:2.0:1789264364.914330:0:20232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311261312 00000100:00100000:2.0:1789264364.914422:0:20232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:2.0:1789264364.914438:0:20232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd292616-4ff1-43bd-9855-5a9de2560302+23:2405:x1876179311261312:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264364.914454:0:20232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264364.914483:0:20232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8412 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafb5 expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.914508:0:20232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:2.0:1789264364.914516:0:20232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264364.914581:0:20232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd292616-4ff1-43bd-9855-5a9de2560302+22:2405:x1876179311261312:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 150us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264364.914597:0:20232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:3.0:1789264364.915536:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311261568 00000100:00100000:3.0:1789264364.915546:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311261568 00000100:00100000:3.0:1789264364.915603:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:3.0:1789264364.915612:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd292616-4ff1-43bd-9855-5a9de2560302+22:15629:x1876179311261568:12345-192.168.203.44@tcp:35:cat.0 00000100:00100000:3.0:1789264364.915909:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd292616-4ff1-43bd-9855-5a9de2560302+23:15629:x1876179311261568:12345-192.168.203.44@tcp:35:cat.0 Request processed in 297us (1777us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789264364.915917:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:0.0:1789264364.988994:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.989095:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311261824 00000100:00100000:3.0:1789264364.989104:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311261824 00000100:00100000:3.0:1789264364.989187:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:3.0:1789264364.989198:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+23:15635:x1876179311261824:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:3.0:1789264364.989224:0:18643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264364.989244:0:18643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8420 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdafbc expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.989363:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed8427 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.989377:0:18643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed83c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf99 expref: 24 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.989385:0:18643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83da lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafa0 expref: 24 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.989393:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed8427 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.989556:0:18643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafa0 expref: 24 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.989570:0:18643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafa0 expref: 24 pid: 17203 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264364.989593:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18643:1876179322847872:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264364.989682:0:18643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed83c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf99 expref: 24 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264364.989693:0:18643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed83c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf99 expref: 24 pid: 18643 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264364.989702:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18643:1876179322848000:192.168.203.44@tcp:104: 00000100:00100000:3.0:1789264364.990249:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8af49480 going to sleep for 11 seconds 00000100:00100000:3.0:1789264364.992307:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18643:1876179322847872:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264364.998269:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264364.998363:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18643:1876179322848000:192.168.203.44@tcp:104: 00010000:00010000:3.0:1789264364.998390:0:18643:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed8427 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264364.998595:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311261952 00000100:00100000:2.0:1789264364.998603:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311261952 00010000:00010000:2.0:1789264364.998637:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafa0 expref: 25 pid: 17203 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264364.998691:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:2.0:1789264364.998701:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd292616-4ff1-43bd-9855-5a9de2560302+25:2403:x1876179311261952:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264364.998716:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264364.998728:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafa0 expref: 25 pid: 17203 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.998740:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafa0 expref: 25 pid: 17203 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.998795:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed83da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafa0 expref: 25 pid: 17203 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.998812:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:2.0:1789264364.998817:0:17191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed8427 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.998826:0:17191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed8427 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264364.998832:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264364.998897:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd292616-4ff1-43bd-9855-5a9de2560302+24:2403:x1876179311261952:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 197us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264364.998905:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:0.0:1789264365.000512:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264365.000571:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311262080 00000100:00100000:2.0:1789264365.000578:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311262080 00010000:00010000:2.0:1789264365.000615:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed83c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf99 expref: 24 pid: 18643 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264365.000664:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:2.0:1789264365.000674:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39833c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd292616-4ff1-43bd-9855-5a9de2560302+24:2402:x1876179311262080:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264365.000687:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264365.000693:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed83c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf99 expref: 24 pid: 18643 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.000704:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed83c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf99 expref: 24 pid: 18643 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.000722:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed83c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaf99 expref: 24 pid: 18643 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.000739:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:2.0:1789264365.000772:0:17190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed8427 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.000781:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed8427 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.000793:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed8427 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.000822:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264365.000878:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39833c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd292616-4ff1-43bd-9855-5a9de2560302+23:2402:x1876179311262080:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 205us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264365.000885:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00010000:00010000:3.0:1789264365.001018:0:18643:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed8427 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.001027:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed8427 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264365.001055:0:18643:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789264365.001181:0:18643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8420 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafbc expref: 24 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.001193:0:18643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc000/0xecaf9f2f14ed8427 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafbc expref: 23 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.001197:0:18643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:3.0:1789264365.001199:0:18643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789264365.001201:0:18643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a813fc000, rc 0) 00000100:00100000:3.0:1789264365.001219:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+23:15635:x1876179311261824:12345-192.168.203.44@tcp:101:dd.0 Request processed in 12025us (12236us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789264365.001223:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:3.0:1789264365.003785:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264365.003884:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311262208 00000100:00100000:0.0:1789264365.003892:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311262208 00000100:00100000:0.0:1789264365.003939:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:0.0:1789264365.003947:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+23:15635:x1876179311262208:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:0.0:1789264365.003969:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264365.003995:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed8435 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdafc3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.004054:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed843c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.004069:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed843c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.004079:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed843c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.004197:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed8435 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafc3 expref: 25 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.004215:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed843c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafc3 expref: 24 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.004224:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:0.0:1789264365.004227:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789264365.004230:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366b400, rc 0) 00000100:00100000:0.0:1789264365.004277:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+24:15635:x1876179311262208:12345-192.168.203.44@tcp:101:dd.0 Request processed in 331us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264365.004283:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:0.0:1789264365.009848:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264365.009998:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311262464 00000100:00100000:2.0:1789264365.010021:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311262464 00000100:00100000:2.0:1789264365.010078:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:2.0:1789264365.010089:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+24:15635:x1876179311262464:12345-192.168.203.44@tcp:36:dd.0 00010000:00010000:2.0:1789264365.010484:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8443 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.010502:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8443 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.010515:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8443 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789264365.010565:0:17204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789264365.010660:0:17204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016364293 reply state 0000000027917533 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8443 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.010673:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8443 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.010681:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:2.0:1789264365.010684:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789264365.010687:0:17204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789264365.010886:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+27:15635:x1876179311262464:12345-192.168.203.44@tcp:36:dd.0 Request processed in 796us (1044us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789264365.010894:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 45 00000020:00080000:2.0:1789264365.010899:0:17204:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789264365.015471:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264365.015814:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311262592 00000100:00100000:0.0:1789264365.015824:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311262592 00000100:00100000:0.0:1789264365.015885:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:0.0:1789264365.015895:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+27:15635:x1876179311262592:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:0.0:1789264365.015920:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264365.015956:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed844a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdafca expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.016086:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed844a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafca expref: 28 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.016102:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed844a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafca expref: 28 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.016121:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:0.0:1789264365.016125:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789264365.016128:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366ae00, rc 0) 00000100:00100000:0.0:1789264365.016315:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+28:15635:x1876179311262592:12345-192.168.203.44@tcp:101:dd.0 Request processed in 420us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264365.016321:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:3.0:1789264365.033882:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264365.033990:0:18356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311262848 00000100:00100000:1.0:1789264365.034001:0:18356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311262848 00000100:00100000:1.0:1789264365.034063:0:18356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:1.0:1789264365.034080:0:18356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd292616-4ff1-43bd-9855-5a9de2560302+28:15635:x1876179311262848:12345-192.168.203.44@tcp:103:dd.0 00010000:00010000:1.0:1789264365.034095:0:18356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264365.034120:0:18356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed844a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafca expref: 28 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.034137:0:18356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:1.0:1789264365.034154:0:18356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264365.034283:0:18356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd292616-4ff1-43bd-9855-5a9de2560302+27:15635:x1876179311262848:12345-192.168.203.44@tcp:103:dd.0 Request processed in 207us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264365.034294:0:18356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:1.0:1789264365.036611:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264365.036686:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311262976 00000100:00100000:3.0:1789264365.036694:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311262976 00000100:00100000:3.0:1789264365.036783:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:3.0:1789264365.036793:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+27:15635:x1876179311262976:12345-192.168.203.44@tcp:58:dd.0 00010000:00010000:3.0:1789264365.036889:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8451 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.036907:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8451 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.036919:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8451 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789264365.038001:0:18643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789264365.038033:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789264365.038425:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789264365.038565:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+27:15635:x1876179311262976:12345-192.168.203.44@tcp:58:dd.0 Request processed in 1770us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264365.038575:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:0.0:1789264365.040644:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264365.040729:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311263104 00000100:00100000:2.0:1789264365.040857:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311263104 00000100:00100000:2.0:1789264365.040943:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 48 00000100:00100000:2.0:1789264365.040953:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+27:15635:x1876179311263104:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:2.0:1789264365.040984:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264365.041003:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed8458 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdafd1 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.041054:0:17205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8451 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.041064:0:17205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed8458 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafd1 expref: 28 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.041083:0:17205:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8451 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.041108:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed8458 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafd1 expref: 28 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.041122:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:2.0:1789264365.041125:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789264365.041129:0:17205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed8458 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafd1 expref: 28 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.041137:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1dc00, rc 0) 00000100:00100000:2.0:1789264365.041206:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+28:15635:x1876179311263104:12345-192.168.203.44@tcp:101:dd.0 Request processed in 254us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264365.041213:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 48 00010000:00010000:2.0:1789264365.450170:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789264365.706858:0:17239:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789264365.706870:0:17239:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789264365.706918:0:17239:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789264365.706930:0:17239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789264365.707275:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3a8c73dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17239:1876179322848128:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789264365.707355:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a964600 going to sleep for 11 seconds 00000100:00100000:0.0:1789264365.718194:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264365.718323:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311263232 00000100:00100000:2.0:1789264365.718333:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311263232 00000100:00100000:2.0:1789264365.718400:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 49 00000100:00100000:2.0:1789264365.718410:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+29:15637:x1876179311263232:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789264365.718444:0:17204:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789264365.718633:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3a8c73dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17239:1876179322848128:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789264365.719353:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+28:15637:x1876179311263232:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 940us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264365.719363:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 49 00000100:00100000:0.0:1789264365.729219:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264365.729304:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311263360 00000100:00100000:3.0:1789264365.729314:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311263360 00000100:00100000:3.0:1789264365.729392:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:3.0:1789264365.729401:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+28:15637:x1876179311263360:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789264365.729469:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed845f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729485:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed845f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729497:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed845f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729513:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8466 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729529:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8466 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729535:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8466 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729557:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed846d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729565:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed846d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729571:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed846d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264365.729626:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789264365.729631:0:17203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789264365.729646:0:17203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed846d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729656:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed845f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729663:0:17203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed845f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729670:0:17203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed845f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729676:0:17203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fd800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264365.729680:0:17203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed845f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729696:0:17203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed845f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729710:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e78400) 00010000:00010000:3.0:1789264365.729713:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264365.729718:0:17203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed845f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729724:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed845f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729776:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8466 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729784:0:17203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8466 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729790:0:17203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8466 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729796:0:17203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fc400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264365.729798:0:17203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8466 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729805:0:17203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8466 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729812:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9c398335f700) 00010000:00010000:3.0:1789264365.729814:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264365.729817:0:17203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8466 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729832:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8466 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729849:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed846d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729855:0:17203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed846d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729860:0:17203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed846d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729866:0:17203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fc600 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264365.729869:0:17203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed846d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729875:0:17203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed846d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729882:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:3.0:1789264365.729885:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264365.729887:0:17203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed846d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.729892:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed846d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264365.729969:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+28:15637:x1876179311263360:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 Request processed in 567us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264365.729976:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:1.0:1789264365.746232:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264365.746365:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311263616 00000100:00100000:3.0:1789264365.746374:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311263616 00000100:00100000:3.0:1789264365.746433:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:3.0:1789264365.746443:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+28:15637:x1876179311263616:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789264365.746461:0:18643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264365.746480:0:18643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed8474 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdafd8 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.746574:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed847b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.746601:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed847b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.746613:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed847b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789264365.746624:0:18643:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789264365.746701:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed847b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.746710:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed847b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.746716:0:18643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed847b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.746721:0:18643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fc400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264365.746726:0:18643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed847b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.746733:0:18643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed847b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.746808:0:18643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:3.0:1789264365.746811:0:18643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789264365.746816:0:18643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed847b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.746822:0:18643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed847b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.746860:0:18643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed8474 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafd8 expref: 30 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.746869:0:18643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c3ab7e78400) 00010000:00010000:3.0:1789264365.746871:0:18643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789264365.746875:0:18643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed8474 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafd8 expref: 30 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.746885:0:18643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a813fc600, rc 0) 00000100:00100000:3.0:1789264365.746940:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+29:15637:x1876179311263616:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 499us (718us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1789264365.746948:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:2.0:1789264365.752718:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264365.753286:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311263744 00000100:00100000:3.0:1789264365.753298:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311263744 00000100:00100000:3.0:1789264365.753367:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:3.0:1789264365.753378:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+29:15637:x1876179311263744:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789264365.753412:0:17205:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789264365.753531:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+29:15637:x1876179311263744:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 155us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264365.753553:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:0.0:1789264365.758958:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264365.759068:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311264000 00000100:00100000:3.0:1789264365.759077:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311264000 00000100:00100000:3.0:1789264365.759150:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:3.0:1789264365.759159:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+29:15637:x1876179311264000:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789264365.759185:0:18643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789264365.759209:0:18643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed8489 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdafdf expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789264365.759552:0:18643:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:3.0:1789264365.759558:0:18643:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:3.0:1789264365.759587:0:18643:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1789264365.759721:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8490 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.759735:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.760072:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.760144:0:18643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc600/0xecaf9f2f14ed8489 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafdf expref: 32 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.760163:0:18643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8490 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafdf expref: 31 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.760379:0:18643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c398335f700) 00010000:00010000:3.0:1789264365.760393:0:18643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789264365.760397:0:18643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3a813fc400, rc 0) 00000100:00100000:3.0:1789264365.760494:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+31:15637:x1876179311264000:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1335us (1545us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1789264365.760501:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:1.0:1789264365.773135:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264365.773260:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311264256 00000100:00100000:3.0:1789264365.773271:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311264256 00000100:00100000:3.0:1789264365.773336:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:3.0:1789264365.773356:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+31:15637:x1876179311264256:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789264365.773425:0:17205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264365.773454:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc400/0xecaf9f2f14ed8490 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafdf expref: 31 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773474:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c398335f700) 00010000:00010000:3.0:1789264365.773486:0:17205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789264365.773509:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed849e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773522:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed849e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773538:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed849e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773552:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x113dc795 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773559:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x113dc795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773592:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x113dc795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773642:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed849e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773649:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed849e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773655:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed849e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773661:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fd800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264365.773665:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed849e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773672:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed849e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773681:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c3a8c3bec00) 00010000:00010000:3.0:1789264365.773684:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264365.773688:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed849e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773694:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fd800/0xecaf9f2f14ed849e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773704:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x113dc795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773709:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84a5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x113dc795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773722:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x113dc795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773727:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cb200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:3.0:1789264365.773729:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x113dc795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773735:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84a5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x113dc795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773741:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x113dc795 (ffff9c398335fc00) 00010000:00010000:3.0:1789264365.773783:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789264365.773786:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84a5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x113dc795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.773791:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84a5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x113dc795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264365.773874:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+30:15637:x1876179311264256:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 529us (751us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789264365.773882:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:2.0:1789264365.778916:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264365.779007:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311264384 00000100:00100000:0.0:1789264365.779017:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311264384 00000100:00100000:0.0:1789264365.779075:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:0.0:1789264365.779085:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+30:15637:x1876179311264384:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264365.779102:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264365.779122:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b200/0xecaf9f2f14ed84ac lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdafe6 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.779157:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a400/0xecaf9f2f14ed84b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.779194:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a400/0xecaf9f2f14ed84b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.779205:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a400/0xecaf9f2f14ed84b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.779313:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b200/0xecaf9f2f14ed84ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafe6 expref: 32 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.779331:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366a400/0xecaf9f2f14ed84b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafe6 expref: 31 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.779339:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264365.779342:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789264365.779346:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366a400, rc 0) 00000100:00100000:0.0:1789264365.779420:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+31:15637:x1876179311264384:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 336us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264365.779427:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:1.0:1789264365.784575:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264365.784686:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311264640 00000100:00100000:3.0:1789264365.784697:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311264640 00000100:00100000:3.0:1789264365.784789:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:3.0:1789264365.784799:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+31:15637:x1876179311264640:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789264365.784900:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84ba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.784917:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.784936:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789264365.785118:0:17205:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1789264365.785128:0:17205:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 446126383153ns, next at 447126380853ns, rc = 0 00000004:00010000:3.0:1789264365.785176:0:17205:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000463e0e2 reply state 0000000067c88b66 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.785189:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.785197:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:3.0:1789264365.785200:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789264365.785203:0:17205:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789264365.785303:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+33:15637:x1876179311264640:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 504us (735us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789264365.785311:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:1.0:1789264365.789656:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264365.789786:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311264768 00000100:00100000:0.0:1789264365.789797:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311264768 00000100:00100000:0.0:1789264365.789851:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:0.0:1789264365.789862:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+33:15637:x1876179311264768:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264365.789884:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264365.789903:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b200/0xecaf9f2f14ed84c1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdafed expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.789959:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b200/0xecaf9f2f14ed84c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafed expref: 34 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.789985:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b200/0xecaf9f2f14ed84c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafed expref: 34 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.790004:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264365.790007:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789264365.790011:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366b200, rc 0) 00000100:00100000:0.0:1789264365.790061:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+34:15637:x1876179311264768:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 201us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264365.790069:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:2.0:1789264365.793639:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264365.793723:0:19869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311264896 00000100:00100000:0.0:1789264365.793732:0:19869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311264896 00000100:00100000:0.0:1789264365.793829:0:19869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:0.0:1789264365.793839:0:19869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd292616-4ff1-43bd-9855-5a9de2560302+5:2402:x1876179311264896:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789264365.794082:0:19869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd292616-4ff1-43bd-9855-5a9de2560302+6:2402:x1876179311264896:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 244us (453us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789264365.794090:0:19869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00080000:2.0:1789264365.794155:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789264365.796800:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264365.796881:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311265152 00000100:00100000:3.0:1789264365.796889:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311265152 00000100:00100000:3.0:1789264365.796947:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:3.0:1789264365.796957:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd292616-4ff1-43bd-9855-5a9de2560302+34:15637:x1876179311265152:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789264365.797167:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd292616-4ff1-43bd-9855-5a9de2560302+35:15637:x1876179311265152:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 210us (373us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1789264365.797183:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:3.0:1789264365.809304:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264365.809538:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311265408 00000100:00100000:2.0:1789264365.809547:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311265408 00000100:00100000:2.0:1789264365.809670:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:2.0:1789264365.809680:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+35:15637:x1876179311265408:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789264365.809823:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+35:15637:x1876179311265408:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 144us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264365.809832:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:1.0:1789264365.815518:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264365.815788:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311265536 00000100:00100000:0.0:1789264365.815803:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311265536 00000100:00100000:0.0:1789264365.815882:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:0.0:1789264365.815895:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+35:15637:x1876179311265536:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789264365.815920:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789264365.815946:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed84c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaff4 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.816039:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed84cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.816074:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed84cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.816090:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed84cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789264365.816150:0:17204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789264365.816354:0:17204:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed84cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.816391:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed84c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaff4 expref: 37 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.816415:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed84cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaff4 expref: 36 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.816425:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264365.816429:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789264365.816433:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c398366ae00, rc 0) 00000100:00100000:1.0:1789264365.818631:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+36:15637:x1876179311265536:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 2715us (3105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264365.818648:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:1.0:1789264365.824074:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264365.824205:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311265664 00000100:00100000:2.0:1789264365.824218:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311265664 00000100:00100000:2.0:1789264365.824291:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:2.0:1789264365.824303:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd292616-4ff1-43bd-9855-5a9de2560302+6:2403:x1876179311265664:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789264365.824328:0:18709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789264365.824357:0:18709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed84d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdaffb expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789264365.824392:0:18709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa601ee, blocks: 0x0 00010000:00010000:2.0:1789264365.824435:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1789264365.824440:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264365.824452:0:18709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed84d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaffb expref: 7 pid: 18709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.824476:0:18709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed84d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaffb expref: 7 pid: 18709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.824493:0:18709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abac1c400, rc 0) 00000100:00100000:2.0:1789264365.824566:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd292616-4ff1-43bd-9855-5a9de2560302+7:2403:x1876179311265664:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 265us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264365.824574:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:3.0:1789264365.831392:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264365.831505:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311265920 00000100:00100000:0.0:1789264365.831518:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311265920 00000100:00100000:0.0:1789264365.831603:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:0.0:1789264365.831615:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+36:15637:x1876179311265920:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789264365.831806:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+36:15637:x1876179311265920:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 193us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264365.831815:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:1.0:1789264365.836882:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264365.837036:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311266048 00000100:00100000:3.0:1789264365.837067:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311266048 00000100:00100000:3.0:1789264365.837145:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:3.0:1789264365.837158:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+36:15637:x1876179311266048:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789264365.844992:0:17184:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1789264365.845041:0:17184:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789264365.845115:0:17184:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1789264365.845285:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8363 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.845301:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8363 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.845310:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8363 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.845318:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9ff800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264365.845324:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8363 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.845332:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8363 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.845354:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c3a8c3bec00) 00010000:00010000:2.0:1789264365.845371:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789264365.845378:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8363 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.845385:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff800/0xecaf9f2f14ed8363 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845552:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed830f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845567:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed830f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845573:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed830f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845587:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fe200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264365.845591:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed830f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845597:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed830f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845607:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c3a8c3bed00) 00010000:00010000:0.0:1789264365.845610:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264365.845614:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed830f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845628:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed830f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845649:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ffa00/0xecaf9f2f14ed8316 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845656:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ffa00/0xecaf9f2f14ed8316 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845662:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ffa00/0xecaf9f2f14ed8316 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845668:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9ffa00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264365.845678:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ffa00/0xecaf9f2f14ed8316 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845685:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ffa00/0xecaf9f2f14ed8316 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845695:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c3a8c3bec00) 00010000:00010000:0.0:1789264365.845697:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264365.845700:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ffa00/0xecaf9f2f14ed8316 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845707:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ffa00/0xecaf9f2f14ed8316 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845720:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed83be lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845726:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed83be lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845732:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed83be lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845738:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fc800 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264365.845741:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed83be lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845801:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed83be lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845810:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c398335fd00) 00010000:00010000:0.0:1789264365.845813:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264365.845823:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed83be lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845830:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fc800/0xecaf9f2f14ed83be lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845852:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8443 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845859:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8443 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845865:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8443 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845870:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1c200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264365.845873:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8443 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845879:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8443 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845889:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:0.0:1789264365.845891:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789264365.845895:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8443 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845901:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1c200/0xecaf9f2f14ed8443 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845914:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845932:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845938:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845943:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c39836cb200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:0.0:1789264365.845946:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845952:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845961:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264365.845964:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789264365.845967:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84ba lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.845974:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c39836cb200/0xecaf9f2f14ed84ba lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264365.846473:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd292616-4ff1-43bd-9855-5a9de2560302+15:15637:x1876179311266048:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 Request processed in 9309us (9596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264365.846485:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:1.0:1789264365.847015:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789264365.847039:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322848256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789264365.847108:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264365.847276:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322848256 00000100:00100000:3.0:1789264365.847287:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322848256 00000100:00100000:3.0:1789264365.847406:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789264365.847417:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322848256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789264365.847591:0:18710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789264365.847595:0:18710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789264365.847598:0:18710:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789264365.847600:0:18710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789264366 -> 1789264366 00002000:00010000:3.0:1789264365.847602:0:18710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789264365.847659:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1876179322848256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 243us (550us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789264365.847666:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789264365.847866:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789264365.847920:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c3983f4a680/2, rc 0, transno 8589934597 00000100:00100000:2.0:1789264365.847927:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322848256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789264365.849140:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264365.849255:0:19869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311266176 00000100:00100000:0.0:1789264365.849264:0:19869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311266176 00000100:00100000:0.0:1789264365.849321:0:19869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:0.0:1789264365.849332:0:19869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd292616-4ff1-43bd-9855-5a9de2560302+7:2402:x1876179311266176:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789264365.849446:0:19869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd292616-4ff1-43bd-9855-5a9de2560302+7:2402:x1876179311266176:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 Request processed in 116us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264365.849454:0:19869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:2.0:1789264365.853168:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264365.853258:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311266432 00000100:00100000:0.0:1789264365.853290:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311266432 00000100:00100000:0.0:1789264365.853366:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:0.0:1789264365.853378:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+15:15637:x1876179311266432:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789264365.853449:0:17203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789264365.853485:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ae00/0xecaf9f2f14ed84cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaff4 expref: 15 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.853508:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264365.853514:0:17203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789264365.853555:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed84dd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.853572:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed84dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.853594:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed84dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789264365.853824:0:17203:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cac661bc reply state 00000000d01fbd93 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed84dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.853841:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366ba00/0xecaf9f2f14ed84dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.853848:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:0.0:1789264365.853851:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789264365.853854:0:17203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789264365.853975:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+16:15637:x1876179311266432:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 598us (820us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789264365.853983:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:2.0:1789264365.857202:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264365.857307:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311266560 00000100:00100000:1.0:1789264365.857320:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311266560 00000100:00100000:1.0:1789264365.857390:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:1.0:1789264365.857402:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd292616-4ff1-43bd-9855-5a9de2560302+7:15637:x1876179311266560:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789264365.857445:0:18709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264365.857471:0:18709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a7d0093/0xecaf9f2f14ed84e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdb002 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.857511:0:18709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed84d6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaffb expref: 8 pid: 18709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.857521:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264365.857526:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264365.857532:0:18709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a7d0093/0xecaf9f2f14ed84e4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdb002 expref: 8 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.857591:0:18709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed84d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaffb expref: 8 pid: 18709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.857607:0:18709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed84d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaffb expref: 8 pid: 18709 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264365.857635:0:18709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18709:1876179322848384:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264365.857778:0:18709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae36f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789264365.862545:0:18709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18709:1876179322848384:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264365.862615:0:18709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a7d0093/0xecaf9f2f14ed84e4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdb002 expref: 8 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.862658:0:18709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abb9ff000, rc 0) 00000100:00100000:2.0:1789264365.862736:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd292616-4ff1-43bd-9855-5a9de2560302+8:15637:x1876179311266560:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 5335us (5547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264365.862783:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:2.0:1789264365.866410:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264365.866921:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311266688 00000100:00100000:1.0:1789264365.866934:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311266688 00010000:00010000:1.0:1789264365.866991:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed84d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaffb expref: 8 pid: 18709 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264365.867080:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:1.0:1789264365.867105:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd292616-4ff1-43bd-9855-5a9de2560302+8:2403:x1876179311266688:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264365.867127:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264365.867159:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed84d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaffb expref: 8 pid: 18709 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.867175:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed84d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaffb expref: 8 pid: 18709 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.867206:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0de838f/0xecaf9f2f14ed84d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdaffb expref: 8 pid: 18709 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.867226:0:17189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264365.867231:0:17189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264365.867238:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a7d0093/0xecaf9f2f14ed84e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdb002 expref: 7 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.867250:0:17189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a7d0093/0xecaf9f2f14ed84e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdb002 expref: 7 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.867297:0:17189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001a7d0093/0xecaf9f2f14ed84e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdb002 expref: 7 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264365.867315:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17189:1876179322848512:192.168.203.44@tcp:105: 00000100:00100000:1.0:1789264365.867430:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae36f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789264365.870194:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17189:1876179322848512:192.168.203.44@tcp:105: 00010000:00010000:3.0:1789264365.870237:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789264365.870312:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd292616-4ff1-43bd-9855-5a9de2560302+7:2403:x1876179311266688:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 3208us (3916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264365.870324:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:0.0:1789264365.871116:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264365.871251:0:19101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311266816 00000100:00100000:1.0:1789264365.871279:0:19101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311266816 00000100:00100000:1.0:1789264365.871340:0:19101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:1.0:1789264365.871353:0:19101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd292616-4ff1-43bd-9855-5a9de2560302+7:2402:x1876179311266816:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789264365.871569:0:19101:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789264365.871573:0:19101:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789264365 00002000:00010000:1.0:1789264365.871575:0:19101:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789264364 00002000:00010000:1.0:1789264365.871586:0:19101:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789264366 -> 1789264365 00002000:00010000:1.0:1789264365.871588:0:19101:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789264365.871659:0:19101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd292616-4ff1-43bd-9855-5a9de2560302+8:2402:x1876179311266816:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 308us (548us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789264365.871667:0:19101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:2.0:1789264365.876432:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264365.876612:0:19869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311266944 00000100:00100000:0.0:1789264365.876636:0:19869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311266944 00000100:00100000:0.0:1789264365.876716:0:19869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:0.0:1789264365.876728:0:19869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd292616-4ff1-43bd-9855-5a9de2560302+8:2403:x1876179311266944:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789264365.876838:0:19869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed84eb lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.876867:0:19869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a7d0093/0xecaf9f2f14ed84e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdb002 expref: 8 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.876877:0:19869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789264365.876883:0:19869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789264365.876888:0:19869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed84eb lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.876936:0:19869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a7d0093/0xecaf9f2f14ed84e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdb002 expref: 8 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.876954:0:19869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a7d0093/0xecaf9f2f14ed84e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdb002 expref: 8 pid: 18709 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264365.876971:0:19869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19869:1876179322848640:192.168.203.44@tcp:104: 00000100:00100000:0.0:1789264365.877078:0:19869:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aa76eb840 going to sleep for 11 seconds 00000100:00100000:0.0:1789264365.880906:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264365.881004:0:20232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311267072 00000100:00100000:1.0:1789264365.881015:0:20232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311267072 00010000:00010000:1.0:1789264365.881064:0:20232:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a7d0093/0xecaf9f2f14ed84e4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdb002 expref: 9 pid: 18709 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264365.881111:0:20232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:1.0:1789264365.881121:0:20232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd292616-4ff1-43bd-9855-5a9de2560302+9:2403:x1876179311267072:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789264365.881140:0:20232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789264365.881166:0:20232:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a7d0093/0xecaf9f2f14ed84e4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdb002 expref: 9 pid: 18709 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.881189:0:20232:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a7d0093/0xecaf9f2f14ed84e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdb002 expref: 9 pid: 18709 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.881221:0:20232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789264365.881241:0:20232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789264365.881248:0:20232:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed84eb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.881259:0:20232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed84eb lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.881284:0:20232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789264365.881477:0:19869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a7d0093/0xecaf9f2f14ed84e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdb002 expref: 9 pid: 18709 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264365.881496:0:19869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19869:1876179322848640:192.168.203.44@tcp:104: 00010000:00010000:2.0:1789264365.881523:0:19869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed84eb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.881541:0:19869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed84eb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.881549:0:19869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed84eb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.881573:0:19869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed84eb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.881590:0:19869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed84eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.881598:0:19869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed84eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.881606:0:19869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366bc00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264365.881610:0:19869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed84eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.881629:0:19869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed84eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.881643:0:19869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed84eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.881662:0:19869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008513aff8/0xecaf9f2f14ed84eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264365.882012:0:20232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd292616-4ff1-43bd-9855-5a9de2560302+8:2403:x1876179311267072:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 889us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264365.882022:0:20232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:2.0:1789264365.882228:0:19869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd292616-4ff1-43bd-9855-5a9de2560302+7:2403:x1876179311266944:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 Request processed in 5502us (5812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264365.882238:0:19869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:2.0:1789264365.891074:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264365.891913:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311267328 00000100:00100000:1.0:1789264365.891929:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311267328 00000100:00100000:1.0:1789264365.892016:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:1.0:1789264365.892039:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+16:15637:x1876179311267328:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789264365.892936:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.892963:0:17204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed843c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafc3 expref: 16 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.892974:0:17204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.893028:0:17204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed843c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafc3 expref: 16 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.893047:0:17204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed843c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafc3 expref: 16 pid: 17203 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264365.893084:0:17204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17204:1876179322848768:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264365.893434:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae36f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789264365.904736:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264365.904915:0:17204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17204:1876179322848768:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264365.904955:0:17204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264365.905112:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311267456 00000100:00100000:2.0:1789264365.905122:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311267456 00010000:00010000:2.0:1789264365.905169:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed843c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafc3 expref: 17 pid: 17203 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264365.905228:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:2.0:1789264365.905239:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd292616-4ff1-43bd-9855-5a9de2560302+17:2402:x1876179311267456:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789264365.905260:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789264365.905268:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed843c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafc3 expref: 17 pid: 17203 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.905281:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed843c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafc3 expref: 17 pid: 17203 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.905308:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed843c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafc3 expref: 17 pid: 17203 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.905327:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:2.0:1789264365.905341:0:17191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed8458 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafd1 expref: 16 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.905353:0:17191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.905361:0:17191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.905370:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.905404:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789264365.905475:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd292616-4ff1-43bd-9855-5a9de2560302+16:2402:x1876179311267456:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 238us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264365.905483:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00010000:00010000:1.0:1789264365.905552:0:17204:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.905560:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.905869:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.905883:0:17204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b200/0xecaf9f2f14ed84c1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafed expref: 16 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.905892:0:17204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.905927:0:17204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b200/0xecaf9f2f14ed84c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafed expref: 16 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.905942:0:17204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b200/0xecaf9f2f14ed84c1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafed expref: 16 pid: 17204 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264365.905961:0:17204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17204:1876179322848896:192.168.203.44@tcp:104: 00000100:00100000:1.0:1789264365.906045:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3aae36f180 going to sleep for 11 seconds 00000100:00100000:1.0:1789264365.928188:0:17204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17204:1876179322848896:192.168.203.44@tcp:104: 00010000:00010000:1.0:1789264365.928231:0:17204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264365.939382:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264365.939494:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311267584 00000100:00100000:3.0:1789264365.939507:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311267584 00010000:00010000:3.0:1789264365.939558:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b200/0xecaf9f2f14ed84c1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafed expref: 17 pid: 17204 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789264365.939640:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:3.0:1789264365.939651:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd292616-4ff1-43bd-9855-5a9de2560302+17:2403:x1876179311267584:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789264365.939670:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789264365.939679:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b200/0xecaf9f2f14ed84c1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafed expref: 17 pid: 17204 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.939694:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b200/0xecaf9f2f14ed84c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafed expref: 17 pid: 17204 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.939734:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b200/0xecaf9f2f14ed84c1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafed expref: 17 pid: 17204 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.939798:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:3.0:1789264365.939804:0:17189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.939815:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.939824:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.940265:0:17204:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.940277:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789264365.940427:0:17204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00010000:00010000:1.0:1789264365.940485:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789264365.940573:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd292616-4ff1-43bd-9855-5a9de2560302+17:2403:x1876179311267584:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 921us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264365.940591:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00000001:00080000:2.0:1789264365.942933:0:17204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789264365.943015:0:17204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789264365.943131:0:17204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983110e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17204:1876179322849024:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789264365.943536:0:17204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264365.943713:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c3e2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789264365.943836:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322849024 00000100:00100000:1.0:1789264365.943846:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322849024 00000100:00100000:1.0:1789264365.943910:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789264365.943920:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17204:x1876179322849024:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789264365.944035:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17204:x1876179322849024:12345-0@lo:1000:mdt00_001.0 Request processed in 117us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264365.944043:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789264365.944130:0:17204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983110e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17204:1876179322849024:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789264365.944392:0:17204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789264365.944463:0:17204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17204:1876179322849152:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789264365.944503:0:17204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264365.944631:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8a0a1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789264365.948731:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322849152 00000100:00100000:1.0:1789264365.948765:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322849152 00000100:00100000:1.0:1789264365.948841:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789264365.948852:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abab43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17204:x1876179322849152:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789264365.949126:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abab43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17204:x1876179322849152:12345-0@lo:1000:mdt00_001.0 Request processed in 275us (4621us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789264365.949134:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789264365.949835:0:17204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17204:1876179322849152:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789264365.949990:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950028:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950037:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950044:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9ff400 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264365.950050:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950060:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950080:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:2.0:1789264365.950084:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789264365.950089:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950095:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff400/0xecaf9f2f14ed84f9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950135:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8451 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950141:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8451 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950147:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8451 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950152:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3a813fcc00 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264365.950161:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8451 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950168:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8451 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950177:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:2.0:1789264365.950179:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789264365.950187:0:17204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed8458 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafd1 expref: 19 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950199:0:17204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed8458 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafd1 expref: 19 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950210:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed8458 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafd1 expref: 19 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.950282:0:17204:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1dc00/0xecaf9f2f14ed8458 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdafd1 expref: 19 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264365.950299:0:17204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983112300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17204:1876179322849280:192.168.203.44@tcp:105: 00000100:00100000:2.0:1789264365.950405:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c3a8c3e2000 going to sleep for 11 seconds 00000100:00100000:0.0:1789264365.964094:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1789264365.964293:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311267712 00000100:00100000:3.0:1789264365.964305:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311267712 00000100:00100000:3.0:1789264365.964387:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:3.0:1789264365.964399:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8b424850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd292616-4ff1-43bd-9855-5a9de2560302+20:15635:x1876179311267712:12345-192.168.203.44@tcp:49:dd.0 00000100:00100000:3.0:1789264365.964875:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8b424850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd292616-4ff1-43bd-9855-5a9de2560302+20:15635:x1876179311267712:12345-192.168.203.44@tcp:49:dd.0 Request processed in 476us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264365.964885:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:2.0:1789264365.965644:0:17204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983112300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17204:1876179322849280:192.168.203.44@tcp:105: 00010000:00010000:2.0:1789264365.965681:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8451 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965694:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3a813fcc00/0xecaf9f2f14ed8451 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965853:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed8500 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965871:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed8500 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965884:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed8500 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965896:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed8500 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965903:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed8500 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965910:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed8500 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965916:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1d000 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264365.965921:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed8500 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965929:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed8500 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965942:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:2.0:1789264365.965946:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789264365.965950:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed8500 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965956:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abac1d000/0xecaf9f2f14ed8500 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965975:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965981:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965988:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.965992:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fe200 already unused, calling callback (ffffffffc1a9e4f0) 00010000:00010000:2.0:1789264365.965996:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.966001:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.966010:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:2.0:1789264365.966013:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789264365.966015:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264365.966020:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fe200/0xecaf9f2f14ed84f2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264365.966386:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd292616-4ff1-43bd-9855-5a9de2560302+19:15637:x1876179311267328:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 74356us (75323us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789264365.966397:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 63 00000020:00080000:2.0:1789264365.966404:0:17204:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789264365.966623:0:17239:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789264365.966629:0:17239:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789264365.966647:0:17239:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789264365.966658:0:17239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789264365.971345:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1789264365.971392:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264365.971489:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311268096 00000100:00100000:1.0:1789264365.971502:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311268096 00000100:00100000:1.0:1789264365.971592:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:1.0:1789264365.971604:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+19:15635:x1876179311268096:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:1.0:1789264365.971663:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789264365.971689:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fec00/0xecaf9f2f14ed8507 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9df94af8b3bdb009 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.971733:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff600/0xecaf9f2f14ed850e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.971785:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff600/0xecaf9f2f14ed850e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.971799:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff600/0xecaf9f2f14ed850e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.971945:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9fec00/0xecaf9f2f14ed8507 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdb009 expref: 21 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.971979:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c3abb9ff600/0xecaf9f2f14ed850e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x9df94af8b3bdb009 expref: 20 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264365.971989:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c398335f900) 00010000:00010000:1.0:1789264365.971992:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789264365.971996:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c3abb9ff600, rc 0) 00000100:00100000:1.0:1789264365.972067:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd292616-4ff1-43bd-9855-5a9de2560302+20:15635:x1876179311268096:12345-192.168.203.44@tcp:101:dd.0 Request processed in 464us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264365.972075:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:3.0:1789264365.973905:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311267968 00000100:00100000:3.0:1789264365.973923:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311267968 00000100:00100000:0.0:1789264365.974086:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:0.0:1789264365.974099:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd292616-4ff1-43bd-9855-5a9de2560302+20:15637:x1876179311267968:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789264365.974472:0:17206:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789264365.974516:0:17206:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789264365.974559:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed8515 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.974589:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed8515 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.974604:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed8515 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.974614:0:17206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed8515 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.974621:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed8515 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.974627:0:17206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed8515 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789264365.974653:0:17206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789264365.974816:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd292616-4ff1-43bd-9855-5a9de2560302+22:15637:x1876179311267968:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 718us (3484us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789264365.974826:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 11 00000020:00080000:0.0:1789264365.974832:0:17206:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789264365.975024:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789264365.975033:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed8515 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.975043:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c398366b400 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:3.0:1789264365.975047:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed8515 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.975056:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed8515 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.975073:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c39824a1600) 00010000:00010000:3.0:1789264365.975077:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789264365.975083:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed8515 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.975100:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c398366b400/0xecaf9f2f14ed8515 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789264365.975127:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264365.975129:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789264365.975131:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789264366.145091:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264366.148800:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311268224 00000100:00100000:2.0:1789264366.148824:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311268224 00000100:00100000:2.0:1789264366.148951:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:2.0:1789264366.148965:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd292616-4ff1-43bd-9855-5a9de2560302+7:2405:x1876179311268224:12345-192.168.203.44@tcp:4:dd.0 00002000:00010000:2.0:1789264366.149033:0:18715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa601ed, atime: 0x6aa601ec, ctime: 0x6aa601ed, blocks: 0x0 00010000:00010000:2.0:1789264366.149046:0:18715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005252ed9b/0xecaf9f2f14ed851c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264366.149066:0:18715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1789264366.149072:0:18715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789264366.149080:0:18715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005252ed9b/0xecaf9f2f14ed851c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264366.149097:0:18715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005252ed9b/0xecaf9f2f14ed851c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789264366.149965:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1789264366.150047:0:18717:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789264366.150059:0:18717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789264366.150320:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311268352 00000100:00100000:0.0:1789264366.150330:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311268352 00000100:00100000:1.0:1789264366.153223:0:20346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:1.0:1789264366.153271:0:20346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd292616-4ff1-43bd-9855-5a9de2560302+8:2404:x1876179311268352:12345-192.168.203.44@tcp:4:dd.0 00010000:00010000:1.0:1789264366.153334:0:20346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8523 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264366.153355:0:20346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264366.153360:0:20346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789264366.153367:0:20346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8523 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264366.153382:0:20346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8523 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789264366.261538:0:19526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:1.0:1789264366.261555:0:19526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:2.0:1789264366.261928:0:20346:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1789264366.261933:0:20346:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789264365 -> 1789264366 00002000:00010000:2.0:1789264366.261935:0:20346:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789264365 -> 1789264366 00002000:00010000:2.0:1789264366.261937:0:20346:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1789264366.261953:0:20346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8523 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264366.261965:0:20346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8523 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264366.261973:0:20346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8523 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264366.262002:0:20346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abb9fec00 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:2.0:1789264366.262007:0:20346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8523 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264366.262015:0:20346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8523 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264366.262035:0:20346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8523 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789264366.262042:0:20346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013cd1a11/0xecaf9f2f14ed8523 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789264366.262142:0:20346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd292616-4ff1-43bd-9855-5a9de2560302+7:2404:x1876179311268352:12345-192.168.203.44@tcp:4:dd.0 Request processed in 108887us (112181us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789264366.262152:0:20346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 1 00000001:00080000:3.0:1789264366.288234:0:19526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1789264366.288607:0:18715:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:1.0:1789264366.288629:0:18715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005252ed9b/0xecaf9f2f14ed851c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264366.288643:0:18715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005252ed9b/0xecaf9f2f14ed851c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264366.288652:0:18715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005252ed9b/0xecaf9f2f14ed851c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264366.288660:0:18715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c3abac1d000 already unused, calling callback (ffffffffc0e8e350) 00010000:00010000:1.0:1789264366.288664:0:18715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005252ed9b/0xecaf9f2f14ed851c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264366.288691:0:18715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005252ed9b/0xecaf9f2f14ed851c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264366.288713:0:18715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005252ed9b/0xecaf9f2f14ed851c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789264366.288721:0:18715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005252ed9b/0xecaf9f2f14ed851c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789264366.288965:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd292616-4ff1-43bd-9855-5a9de2560302+5:2405:x1876179311268224:12345-192.168.203.44@tcp:4:dd.0 Request processed in 139999us (143888us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789264366.288976:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 0 00010000:00010000:2.0:1789264366.475020:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789264366.543496:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264366.543534:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264366.543558:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264366.543595:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264366.543610:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264366.543626:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264366.543642:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264366.543669:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1789264366.543708:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311269248 00000100:00100000:2.0:1789264366.543717:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311269248 00000100:00100000:2.0:1789264366.543800:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311268864 00000100:00100000:2.0:1789264366.543803:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311268864 00000100:00100000:2.0:1789264366.543821:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311269376 00000100:00100000:2.0:1789264366.543823:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311269376 00000100:00100000:2.0:1789264366.543842:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:2.0:1789264366.543851:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8422a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+5:2403:x1876179311269248:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264366.543912:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8422a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+5:2403:x1876179311269248:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 62us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264366.543920:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:2.0:1789264366.544034:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:2.0:1789264366.544040:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd292616-4ff1-43bd-9855-5a9de2560302+5:2403:x1876179311268864:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264366.544065:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd292616-4ff1-43bd-9855-5a9de2560302+5:2403:x1876179311268864:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 25us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264366.544071:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:2.0:1789264366.544081:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:2.0:1789264366.544086:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+5:2403:x1876179311269376:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264366.544104:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3542bc01-ba46-418a-baf3-94035bd58f4f+5:2403:x1876179311269376:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 18us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264366.544110:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00080000:2.0:1789264366.544125:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789264366.544128:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789264366.544145:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311268736 00000100:00100000:2.0:1789264366.544148:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311268736 00000100:00080000:2.0:1789264366.544161:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789264366.544189:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311268992 00000100:00100000:2.0:1789264366.544198:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311268992 00000100:00080000:2.0:1789264366.544210:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264366.544223:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311268608 00000100:00100000:2.0:1789264366.544226:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311268608 00000100:00080000:2.0:1789264366.544235:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264366.544245:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311269120 00000100:00100000:2.0:1789264366.544248:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311269120 00000100:00080000:2.0:1789264366.544257:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789264366.544269:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:2.0:1789264366.544275:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+5:2403:x1876179311268736:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264366.544308:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+5:2403:x1876179311268736:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 32us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264366.544316:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:0.0:1789264366.544327:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179311268480 00000100:00100000:2.0:1789264366.544333:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:0.0:1789264366.544333:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179311268480 00000100:00100000:2.0:1789264366.544342:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3542bc01-ba46-418a-baf3-94035bd58f4f+6:2403:x1876179311268992:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264366.544369:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3542bc01-ba46-418a-baf3-94035bd58f4f+6:2403:x1876179311268992:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 28us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264366.544376:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:2.0:1789264366.544388:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:2.0:1789264366.544395:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+22:2403:x1876179311268608:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264366.544423:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 161 00000100:00100000:2.0:1789264366.544425:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd292616-4ff1-43bd-9855-5a9de2560302+22:2403:x1876179311268608:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 29us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264366.544435:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:2403:x1876179311268480:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1789264366.544436:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:2.0:1789264366.544454:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:2.0:1789264366.544463:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3542bc01-ba46-418a-baf3-94035bd58f4f+5:2403:x1876179311269120:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1789264366.544472:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c15e3cda-8a20-42cd-8b8c-4b2123105b47+13:2403:x1876179311268480:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 39us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789264366.544479:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 161 00000100:00100000:2.0:1789264366.544493:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3542bc01-ba46-418a-baf3-94035bd58f4f+5:2403:x1876179311269120:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 31us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264366.544506:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 46 00010000:00010000:2.0:1789264367.506853:0:18738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789264367.573659:0:20383:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1789264367.626898:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abad80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322849408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789264367.626981:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264367.627183:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322849920:0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.627216:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264367.627235:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322850432:0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.627260:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264367.627276:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322850944:0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.627297:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264367.627317:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789264367.627324:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322849792:0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.627349:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264367.627368:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322850304:0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.627390:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264367.627409:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322850816:0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.627436:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789264367.627467:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322849920 00000100:00100000:3.0:1789264367.627474:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322849920 00000100:00100000:3.0:1789264367.627528:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322849792 00000100:00100000:3.0:1789264367.627532:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322849792 00000100:00100000:3.0:1789264367.627553:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322850304 00000100:00100000:3.0:1789264367.627555:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322850304 00000100:00100000:3.0:1789264367.627594:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789264367.627604:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322849920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.627653:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322849920:12345-0@lo:400:kworker.0 Request processed in 51us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264367.627674:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789264367.627695:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789264367.627700:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322849792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.627731:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1876179322849792:12345-0@lo:400:kworker.0 Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264367.627737:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789264367.627780:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789264367.627788:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322850304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.627818:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322850304:12345-0@lo:400:kworker.0 Request processed in 31us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264367.627825:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789264367.627864:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322850432 00000100:00100000:3.0:1789264367.627868:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322850432 00000100:00100000:3.0:1789264367.627896:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322850944 00000100:00100000:3.0:1789264367.627899:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322850944 00000100:00100000:3.0:1789264367.627913:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322850816 00000100:00100000:3.0:1789264367.627916:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322850816 00000100:00100000:3.0:1789264367.627927:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789264367.627934:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322850432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.627965:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1876179322850432:12345-0@lo:400:kworker.0 Request processed in 32us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264367.627971:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789264367.627982:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789264367.627988:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1876179322850944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.628013:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1876179322850944:12345-0@lo:400:kworker.0 Request processed in 26us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264367.628029:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789264367.628042:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789264367.628048:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3983f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322850816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.628078:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3983f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1876179322850816:12345-0@lo:400:kworker.0 Request processed in 31us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264367.628083:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1789264367.628110:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789264367.628113:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789264367.628116:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789264367.628118:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789264367.628160:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322849792:0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.628172:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322850304:0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.628180:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1876179322850816:0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.628189:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934599 gen 2 00000004:00080000:3.0:1789264367.628194:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c3983f4a680, transno 8589934597 00000004:00080000:3.0:1789264367.628205:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934599 committed transno 8589934599 00000100:00100000:3.0:1789264367.628223:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1876179322849920:0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.628234:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1876179322850432:0@lo:400:kworker.0 00010000:00080000:3.0:1789264367.628245:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983f51180 x1876179322850944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789264367.628254:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1876179322850944:0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.628445:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3624:1876179322849536:0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.628505:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264367.628538:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322850048:0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.628577:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264367.628598:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322850560:0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.628620:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264367.628637:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abac6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322851072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789264367.628662:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264367.628684:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789264367.628691:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3abab42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322849664:0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.628714:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264367.628731:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322850176:0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.628777:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264367.628793:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c3983df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322850688:0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.628813:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789264367.628836:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322850048 00000100:00100000:2.0:1789264367.628840:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322850048 00000100:00100000:2.0:1789264367.628859:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322850560 00000100:00100000:2.0:1789264367.628861:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322850560 00000100:00100000:2.0:1789264367.628885:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322850688 00000100:00100000:2.0:1789264367.628889:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322850688 00000100:00100000:2.0:1789264367.628915:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789264367.628921:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322850048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.628957:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876179322850048:12345-0@lo:400:kworker.0 Request processed in 36us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264367.628963:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789264367.628978:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789264367.628984:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c398465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876179322850560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.629009:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c398465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876179322850560:12345-0@lo:400:kworker.0 Request processed in 26us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264367.629014:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789264367.629025:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789264367.629030:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3a8c73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322850688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.629052:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3a8c73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876179322850688:12345-0@lo:400:kworker.0 Request processed in 22us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264367.629057:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789264367.629072:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322849664 00000100:00100000:2.0:1789264367.629076:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322849664 00000100:00100000:2.0:1789264367.629089:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322850176 00000100:00100000:2.0:1789264367.629091:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322850176 00000100:00100000:2.0:1789264367.629101:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789264367.629106:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322849664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.629134:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1876179322849664:12345-0@lo:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264367.629139:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789264367.629148:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789264367.629153:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322850176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.629185:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322850176:12345-0@lo:400:kworker.0 Request processed in 32us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789264367.629190:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789264367.629215:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1876179322849664:0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.629223:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322850176:0@lo:400:kworker.0 00010000:00080000:2.0:1789264367.629231:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c3983df5500 x1876179322850688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789264383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789264367.629239:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1876179322850688:0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.629247:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876179322850048:0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.629253:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3983df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1876179322850560:0@lo:400:kworker.0 00000100:00100000:1.0:1789264367.629415:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322849408 00000100:00100000:1.0:1789264367.629420:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322849408 00000100:00100000:1.0:1789264367.629442:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322851072 00000100:00100000:1.0:1789264367.629445:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322851072 00000100:00100000:1.0:1789264367.629455:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789264367.629462:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abad83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322849408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789264367.629484:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789264367.629531:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abad83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1876179322849408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264367.629538:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789264367.629554:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789264367.629563:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39847a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322851072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789264367.629587:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:1.0:1789264367.629631:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39847a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1876179322851072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264367.629638:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789264367.629664:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322851200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789264367.629698:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264367.629994:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322851200 00000100:00100000:1.0:1789264367.629998:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322851200 00000100:00100000:1.0:1789264367.630017:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789264367.630022:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c39836e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322851200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789264367.630032:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:1.0:1789264367.630061:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c39836e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876179322851200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264367.630067:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789264367.630100:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1876179322851200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789264367.630561:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322849536 00000100:00100000:3.0:1789264367.630577:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322849536 00000100:00100000:3.0:1789264367.630616:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789264367.630623:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3984627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:3624:x1876179322849536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789264367.630663:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3984627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33d0f4c0-a3be-407d-95bb-bba0d070d9d9+24:3624:x1876179322849536:12345-0@lo:400:kworker.0 Request processed in 40us (2158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789264367.630668:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789264367.630762:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abad80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1876179322849408:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789264367.631037:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789264367.631043:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789264367.631046:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789264367.632770:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abab43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33d0f4c0-a3be-407d-95bb-bba0d070d9d9:3624:1876179322849536:0@lo:400:kworker.0 00000100:00100000:2.0:1789264367.632803:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c3abac6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1876179322851072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789264368.139237:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c39836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322851328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789264368.139326:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789264368.139444:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876179322851328 00000100:00100000:1.0:1789264368.139452:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876179322851328 00000100:00100000:1.0:1789264368.140872:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789264368.140890:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c3abac6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322851328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789264368.140914:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789264368.140993:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c3abac6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876179322851328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789264368.141000:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789264368.141188:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c39836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1876179322851328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789264368.521958:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 39579 lines, 39579 kept, 0 dropped, 0 bad.